-- Logs begin at Wed 2022-05-25 13:54:21 UTC, end at Wed 2022-05-25 15:18:41 UTC. -- May 25 14:46:06.575068 dv-cinder-803823-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 25 14:46:06.586081 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 25 14:46:06.586991 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 14:46:06 2022] *** May 25 14:46:06.586991 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 14:46:06.586991 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 14:46:06.586991 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: nodename: dv-cinder-803823-9-iscsi May 25 14:46:06.586991 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: machine: x86_64 May 25 14:46:06.586991 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: clock source: unix May 25 14:46:06.586991 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: pcre jit disabled May 25 14:46:06.586991 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: detected number of CPU cores: 4 May 25 14:46:06.586991 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: current working directory: / May 25 14:46:06.586991 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: detected binary path: /usr/bin/uwsgi-core May 25 14:46:06.586991 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: your processes number limit is 47680 May 25 14:46:06.586991 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: your memory page size is 4096 bytes May 25 14:46:06.586991 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: detected max file descriptor number: 2048 May 25 14:46:06.586991 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: lock engine: pthread robust mutexes May 25 14:46:06.586991 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: thunder lock: enabled May 25 14:46:06.586991 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 25 14:46:06.588580 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 14:46:06.632317 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: Python main interpreter initialized at 0x56359dabb9c0 May 25 14:46:06.632317 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: python threads support enabled May 25 14:46:06.632317 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: your server socket listen backlog is limited to 100 connections May 25 14:46:06.632317 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: your mercy for graceful operations on workers is 90 seconds May 25 14:46:06.632744 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: mapped 403077 bytes (393 KB) for 2 cores May 25 14:46:06.632744 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: *** Operational MODE: preforking *** May 25 14:46:06.633038 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: *** uWSGI is running in multiple interpreter mode *** May 25 14:46:06.633038 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: spawned uWSGI master process (pid: 109605) May 25 14:46:06.633265 dv-cinder-803823-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 25 14:46:06.634335 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: spawned uWSGI worker 1 (pid: 109606, cores: 1) May 25 14:46:06.634335 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: spawned uWSGI worker 2 (pid: 109607, cores: 1) May 25 14:46:06.634335 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 14:46:07.844164 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 14:46:07.844922 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 14:46:08.604308 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:46:08.604308 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: from cryptography.utils import int_from_bytes May 25 14:46:08.604645 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:46:08.604645 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: from cryptography.utils import int_from_bytes May 25 14:46:08.604895 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:46:08.604895 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: from cryptography.utils import int_from_bytes May 25 14:46:08.605079 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:46:08.605079 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: from cryptography.utils import int_from_bytes May 25 14:46:11.280585 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 14:46:11.281157 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 14:46:11.281505 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 14:46:11.281588 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 14:46:11.281689 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 14:46:11.281763 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 14:46:11.281829 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 14:46:11.281913 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 14:46:11.281987 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 14:46:11.282185 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 14:46:11.282356 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.282578 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.282675 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.282913 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.283014 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.283243 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.283338 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.283573 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.283669 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.284448 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.284559 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.284769 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.285034 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.285120 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.285364 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.285456 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.285694 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.285789 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.285956 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.286064 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.286303 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.286400 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.286632 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-9-iscsi {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.286719 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-9-iscsi {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.286957 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.287050 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.287261 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.287356 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.287574 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.287665 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.287887 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.287984 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.288191 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.288293 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.288511 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.288596 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.288819 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.288902 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.289318 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.289432 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.289758 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.289870 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.290084 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.290220 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.290647 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.290770 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.290884 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.291024 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.291024 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.291236 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.291361 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.291599 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.291735 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.291820 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.291945 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.292080 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.292271 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.292379 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.292562 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.292704 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.292963 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-9-iscsi {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.293173 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-9-iscsi {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.293317 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.293411 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.293581 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.293707 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.293891 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.293977 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.294341 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.294500 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.294668 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.294819 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.295039 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.295213 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.295366 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.295519 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.295612 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.295765 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.295897 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.295994 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.296222 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.296310 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.296545 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.296635 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.296864 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.296951 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.297178 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.297276 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.297482 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.297576 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.297790 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.297919 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.298128 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.298233 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.298459 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.298691 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.298785 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.298873 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.299060 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.299156 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.299314 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.299496 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.299731 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.299826 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.300571 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.300672 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.300897 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.300994 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.301220 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.301316 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.301472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.301559 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.301722 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.301819 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.302062 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.302186 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.302398 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.302590 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.302713 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.302836 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.303007 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.303152 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.303293 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.303391 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.303607 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.303754 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.303909 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.304028 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.304218 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.304385 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.304539 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.304679 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.304828 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.305017 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.305160 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.305421 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.305421 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.305627 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.305756 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.305858 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.306165 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.306287 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.306416 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.306621 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.306798 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.306894 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.307037 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.307122 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.307344 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.307548 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.307729 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.307855 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.308098 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.308187 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.308304 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.308391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.308625 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.308710 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.308926 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.309026 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.309218 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.309300 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.309531 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.309632 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.309838 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.309959 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.310182 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.310382 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.310512 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.310614 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.310820 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.310907 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.311070 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.311164 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.311369 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.311464 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.311678 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.311770 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.312002 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.312098 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.312309 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.312404 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.312615 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.312715 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.312920 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.313008 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.313217 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.313317 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.313526 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.313612 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.313830 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.313915 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.314157 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.314263 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.314463 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.314550 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.314769 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.314860 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.315121 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.315213 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.315432 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.315521 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.315743 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.315831 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.316049 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.316138 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.316372 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.316472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.316695 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.316782 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.316990 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.317085 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.317300 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.317408 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.317605 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.317707 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.317914 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.318063 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.318259 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.318345 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.318568 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.318662 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.318871 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.318957 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.319194 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.319287 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.319498 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.319583 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.319804 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.319928 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.320119 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.320205 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.320427 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.320512 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.320731 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.320817 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.321049 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.321142 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.321347 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.321441 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.321654 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.321739 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.321976 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.322147 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.322311 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.322409 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.322635 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.322766 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.322922 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.323007 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.323226 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.323327 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.323530 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.323615 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.323833 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.323919 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.324140 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.324240 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.324442 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.324528 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.324745 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.324831 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.325060 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.325147 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.325382 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.325468 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.325688 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.325774 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.325996 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.326139 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.326325 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.326423 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.326649 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.326737 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:46:11.326991 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.327077 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.327319 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.327413 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.327662 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.327750 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.327975 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.328068 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.328304 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.328391 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.328637 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.328734 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.328974 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.329067 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.329292 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.329392 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.329579 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.329681 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.329902 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.329991 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.330261 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.330369 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.330546 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.331173 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.331394 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.331480 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.331720 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.331806 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.332044 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.332192 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.332376 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.332462 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.332691 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.332786 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.333008 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.333106 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.333326 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.333420 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.333639 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.333780 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.333955 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.334103 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.334310 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.334397 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.334631 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.334724 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.334943 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.335029 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.335282 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.335369 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.335631 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.335736 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.335944 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.336030 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.336266 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.336400 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.336595 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.336754 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.337082 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.337290 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.337290 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.337464 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.337552 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.337633 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.337818 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.337908 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.338185 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.338304 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.338496 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.338666 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.338812 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.338892 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.339116 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.339209 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.339430 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.339539 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.339735 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.339854 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.340047 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.340133 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.342787 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.342942 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.343023 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.343093 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.343160 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.343297 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.343385 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.343475 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.343556 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.343632 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.343711 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.343798 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.343890 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.344023 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.344107 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.344246 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.344331 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.344456 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.344548 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.344619 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.344693 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.344761 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.344878 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.344965 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.345098 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.345183 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.345307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.345398 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.345532 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.345624 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.345758 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.345843 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.345968 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.346107 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.346190 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.346362 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.346968 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.347048 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.347124 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.347252 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.347336 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.347474 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.347582 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.347669 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.347793 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.347876 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.347999 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.348091 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.348220 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.348307 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.348526 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.348616 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.348854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.348957 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.349171 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.349310 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.349477 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.349566 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.349808 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.350003 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.350121 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.350200 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.350431 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.350579 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.350793 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.350951 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.351177 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.351282 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.351372 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.351531 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.351626 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.351707 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.351931 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.352025 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.352251 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.352361 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.352567 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.352661 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.352874 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.352968 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.353214 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.353322 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.353542 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.353626 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.353843 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.353935 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.354196 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.354303 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.354542 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.354638 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.354883 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.354985 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.355208 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.355318 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.355482 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.355567 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.355761 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.355835 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.356113 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.356217 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.356368 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.356486 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.356676 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.356764 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.356976 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.357064 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.357326 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.357493 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.357729 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.357844 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.357960 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.358108 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.358226 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.358331 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.358508 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.358706 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.358809 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.358891 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.359109 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.359198 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.359412 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.359496 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.359713 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.359806 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.360059 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.360144 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.360360 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.360459 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.360707 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.360801 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.361041 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.361135 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.361416 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.361531 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.361745 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.361845 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.362109 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.362212 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.362409 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.362523 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.362722 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.362830 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.363036 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.363131 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.363349 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.363465 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.363660 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.363744 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.363978 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.364070 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.364293 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.364392 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.364613 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.364699 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.364958 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.365057 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.365247 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.365386 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.365559 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.365645 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.365876 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.365960 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.366210 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.366298 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.366532 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.366615 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.366875 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.366968 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.367208 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.367304 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.367528 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.367620 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.367909 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.368011 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.368246 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.368368 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.368471 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.368670 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.368754 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.368880 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.369052 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.369138 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.369361 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.369455 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.369674 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.369767 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.370002 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.370129 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.370321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.370408 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.370646 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.370800 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.370976 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.371070 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.371325 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.371421 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.371609 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.371710 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.371903 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.371990 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.372267 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.372367 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.372521 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.372685 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.372846 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.373042 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.373165 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.373300 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.373478 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.373564 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.373789 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.373893 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.374135 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.374230 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.374447 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.374540 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.374757 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.374917 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.375073 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.375204 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.375377 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.375478 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.375676 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.375782 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.375990 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.376094 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.376373 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.376483 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.376604 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.376697 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.376913 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.377020 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.377219 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.377314 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.377577 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.377677 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.377887 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.378005 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.378217 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.378320 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.378514 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.378621 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.378828 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.378995 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.379133 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.379270 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.379438 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.379579 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.379761 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.379912 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.380078 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.380218 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.380382 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.380528 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.380678 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.380902 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.381054 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.381197 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.381382 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.381573 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.381780 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.381956 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.382155 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.382408 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.382588 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.382791 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.382957 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.383110 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.383355 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.383560 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.383738 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.383892 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.384058 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.384216 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.384392 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.384553 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.384729 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.384905 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.385094 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.385216 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.385416 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.385543 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.385666 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.385815 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.385976 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.386121 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.386243 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.386381 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.386522 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.386672 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.386804 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.386939 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.387059 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.387178 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.387308 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.387442 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.387561 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.387689 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.387816 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.387935 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.388064 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.388183 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.388301 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.388434 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.388596 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.388719 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.388896 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.389017 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.389187 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.389310 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.389448 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.389567 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.389697 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.389817 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.389935 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.390074 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.390274 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.390410 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.390598 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.390720 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.390927 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.391053 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.391255 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.391464 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.391603 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.391724 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.391903 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.392077 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.392244 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.392383 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.392549 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.392773 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.392916 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.393626 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.393816 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.393977 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.393977 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.394308 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.394308 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.394548 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.394669 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.394787 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.394906 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.395035 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.395217 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.395361 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.395547 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.395689 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.395814 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.395952 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.396117 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.396241 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.396425 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.396547 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.396726 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.396863 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.397042 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.397164 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.397349 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.397479 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.397655 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.397786 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.397963 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.398151 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.398312 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.398465 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.398603 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.398739 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.398906 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.399042 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.399180 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.399300 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.399486 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.399609 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.399829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.399952 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.400132 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.400253 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.400471 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.400592 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.400793 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.400914 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.401141 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.401279 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.401445 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.401575 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.401762 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.401896 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.402149 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.402294 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.402499 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.402619 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.402780 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.402899 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.403054 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.403189 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.403309 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.403446 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.403564 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.403683 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.403811 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.404238 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.404378 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.404567 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.404688 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.404899 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.405029 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.405275 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.405407 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.405717 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.405845 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.405966 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.406213 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.406334 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.406523 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.406653 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.406863 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.406987 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.407120 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.407283 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.407404 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.407524 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.407655 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.407776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.407906 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.408033 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.408152 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.408279 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.408398 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.408517 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.408651 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.408863 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.408986 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.409106 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.409225 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.409361 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.409480 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.409600 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.409719 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.409840 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.410624 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.410782 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.410905 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.411034 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.411152 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.411297 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.411427 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.411563 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.411751 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.411894 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.412066 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.412213 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.412371 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.412525 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.412676 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.412836 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.412985 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.413154 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.413288 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.413464 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.413593 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.413775 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.413905 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.414112 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.414261 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.414443 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.414579 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.414768 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.414885 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.415078 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.415195 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.415396 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.415502 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.415708 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.415839 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.416019 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.416149 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.416327 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.416416 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.416641 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.416728 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.416956 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.417043 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.417252 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.417336 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.417556 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.417648 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.417858 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.417943 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.418192 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.418288 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.418501 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.418595 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.418806 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.418903 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.419108 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.419201 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.419410 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.419503 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.419721 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.419824 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.420045 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.420151 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.420363 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.420496 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.420691 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.420835 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.421003 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.421090 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.421326 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.421580 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.421678 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.421759 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.421929 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.422040 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.422267 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.422368 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.422571 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.422658 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.422876 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.422969 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.423184 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.423279 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.423497 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.423582 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.423796 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.423889 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.424102 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.424203 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.424436 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.424575 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.424765 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.424851 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.425073 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.425397 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.425724 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.426246 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.426559 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.426936 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.427289 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.427923 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.428054 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.428420 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.428774 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.429246 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.429702 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.430072 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.430557 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.430911 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.431254 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.431479 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.431576 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.431827 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.431922 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.432166 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.432252 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.432500 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.432594 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.432835 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.432920 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.433166 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.433258 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.433489 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.433582 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.433832 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.433942 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.434158 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.434248 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.434480 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.434565 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.434796 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.434891 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.435131 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.435216 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.435452 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.435537 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.435762 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.435847 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.436089 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.436226 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.436404 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.436517 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.436725 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.436819 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.437039 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.437138 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.437493 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.437588 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.437814 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.437939 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.438157 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.438383 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.438500 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.438727 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.438821 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.439084 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.439169 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.439408 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.439494 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.439729 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.439862 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.440071 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.440174 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.440404 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.440828 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.441148 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.441628 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.442202 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.442552 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.442955 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.443297 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.443646 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.444096 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.444446 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.444710 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.445060 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.445406 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.445703 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.446088 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.446426 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.446711 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.446800 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.447046 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.447132 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.447377 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.447473 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.447705 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.447798 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.448038 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.448123 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.448358 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.448552 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.448790 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.448881 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.449095 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.449180 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.449515 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.449634 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.449747 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.449835 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.450165 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.450480 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.450579 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.450661 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.450814 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.451161 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.451259 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.451340 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.451569 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.451652 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.451759 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.451990 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.452085 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.452166 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.452379 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.452473 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.452711 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.453140 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.453225 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.453304 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.453382 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.453469 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.453630 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.453725 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.453952 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.454054 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.454294 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.454395 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.454613 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.454701 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.454938 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.455038 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.455255 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.455363 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.456117 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.456320 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.456554 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.456689 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.456885 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.457043 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.457339 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.457544 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.457703 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.457869 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.458122 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.458234 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.458443 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.458537 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.458762 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.458849 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.459081 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.459176 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.459393 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.459478 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.459705 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.459790 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.460031 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.460131 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.460340 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.460432 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.460653 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.460738 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.460965 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.461051 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.461272 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.461356 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.461577 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.461669 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.461885 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.462036 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.462236 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.462323 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.462540 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.462624 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.462868 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.462955 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.463185 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.463270 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.463491 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.463582 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.463820 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.463906 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.464129 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.464276 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.464437 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.464532 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.464747 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.464832 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.465054 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.465152 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.465361 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.465457 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.465671 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.465757 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.466047 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.466145 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.466342 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.466592 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.466689 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.466771 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.466985 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.467072 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.467319 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.467427 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.467647 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.467734 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.467972 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.468066 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.468297 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.468392 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.468627 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.468721 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.468938 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.469104 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.469249 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.469439 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.469567 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.469814 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.469900 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.470160 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.470347 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.470476 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.470565 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.470786 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.470929 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.471096 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.471981 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.472149 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.472248 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.472356 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.472444 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.472612 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.473435 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.473557 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.473557 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.473707 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.473773 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.473848 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.473928 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.474056 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.474197 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.474326 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.474454 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.474619 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.474764 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.474906 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.475052 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.475326 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.475466 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.475644 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.475737 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.475957 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.476044 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.476299 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.476419 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.476625 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.476778 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.476952 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.477085 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.477286 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.477432 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.477656 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.477801 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.477939 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.478071 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.478247 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.478345 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.478569 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.478663 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.478965 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.479172 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.479263 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.479360 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.479505 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.479593 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.479822 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.479910 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.480139 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.480225 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.480447 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.480540 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.480766 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.480852 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.481083 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.481171 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.481404 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.481658 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.481965 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.482094 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.482321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.482412 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.482640 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.482728 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.482953 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.483039 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.483271 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.483365 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.483586 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.483671 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.483901 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.484000 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.484210 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.484296 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.484525 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.484610 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.484833 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.484927 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.485149 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.485258 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.485479 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.485577 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.485795 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.485891 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.486148 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.486251 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.486470 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.486555 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.486793 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.487019 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.487125 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.487355 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.487448 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.487528 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.487758 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.487856 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.488101 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.488197 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.488415 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.488521 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.488722 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.488818 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.489039 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.489133 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.489351 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.489455 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.489666 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.489772 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.489976 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.490103 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.490321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.490465 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.490633 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.490720 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.490947 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.491034 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.491261 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.491349 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.491572 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.491658 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.491885 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.491972 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.492198 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.492307 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.492523 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.492628 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.492858 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.492987 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.493182 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.493310 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.493499 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.493689 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.493812 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.494040 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.494143 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.494604 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.494692 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.494985 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.495086 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.495400 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.495502 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.495673 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.495871 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.495954 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.496034 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.496270 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.496385 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.496590 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.496678 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.496920 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.497035 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.497224 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.497312 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.497532 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.497636 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.497842 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.497939 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.498178 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.498286 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.498487 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.498582 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.498817 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.498913 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.499131 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.499217 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.499432 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.499519 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.499757 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.499851 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.500064 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.500149 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.500608 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.500711 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.500958 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.501047 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.501274 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.501359 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.501607 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.501692 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.501941 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.502287 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.502382 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.502633 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.502733 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.502964 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.503060 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.503273 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.503359 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.503580 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.503674 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.503898 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.503984 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.504208 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.504292 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.504515 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.504612 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.504818 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.504905 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.505134 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.505222 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.505444 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.505545 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.505751 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.505844 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.506081 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.506170 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.506390 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.506491 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.506719 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.506804 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.507022 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.507121 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.507327 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.507414 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.507628 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.507714 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.507941 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.508035 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.508243 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.508346 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.508548 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.508633 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.508856 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.508941 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.509161 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.509249 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.509474 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.509559 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.509774 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.509871 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.510106 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.510194 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.510413 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.510499 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.510725 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.510811 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.511025 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.511111 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.511335 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.511421 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.511689 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.511787 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.512018 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.512103 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.512322 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.512407 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.512628 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.512721 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.512941 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.513026 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.513254 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.513340 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.513573 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.513667 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.513888 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.513973 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.514226 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.514312 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.514577 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.514677 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.514896 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.514990 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.515449 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.515547 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.515786 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.515920 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.516107 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.516193 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.516442 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.516547 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.516773 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.516860 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.517092 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.517199 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.517381 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.517467 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.517687 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.517774 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.518030 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.518640 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.518886 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.518982 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.519206 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.519299 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.519517 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.519604 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.519830 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.519925 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.520141 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.520235 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.520454 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.520539 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.520765 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.520859 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.521077 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.521175 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.521386 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.521472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.521698 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.521785 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.522005 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.522113 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.522341 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.522426 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.522648 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.522781 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.522965 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.523052 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.523313 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.523399 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.523632 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.523734 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.523951 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.524036 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.524265 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.524352 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.524584 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.524670 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.524893 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.524987 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.525206 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.525303 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.525515 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.525607 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.525826 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.525913 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.526171 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.526286 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.526502 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.526591 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.526815 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.526900 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.527138 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.527272 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.527553 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.527649 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.527869 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.527962 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.528189 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.528276 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.528512 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.528598 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.529073 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.529167 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.529403 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.529489 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.529727 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.529821 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.530059 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.530157 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.530388 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.530476 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.530751 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.530844 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.531030 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.531195 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.531370 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.531456 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.531698 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.531783 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.532026 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.532120 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.532331 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.532418 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.532640 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.532729 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.532948 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.533046 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.533258 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.533346 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.533575 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.533670 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.534465 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.534578 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.534781 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.534868 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.535093 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.535178 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.535407 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.535493 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.535711 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.535796 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.536016 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.536144 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.536322 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.536414 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.536622 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.536717 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.536933 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.537019 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.537234 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.537364 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.537539 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.537635 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.537839 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.537938 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.538164 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.538264 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.538468 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.538562 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.538772 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.538871 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.539083 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.539176 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.539386 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.539472 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.539690 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.539784 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.539996 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.540091 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.540299 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.540386 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.540599 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.540694 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.540930 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.541017 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.541265 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.541351 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.541581 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.541667 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.541905 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.541990 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.542244 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.542332 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.542574 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.542684 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.542884 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.542970 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.543207 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.543338 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.543527 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.543615 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.543850 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.544010 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.544147 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.544247 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.544480 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.544576 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.544788 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.544943 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.545100 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.545197 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.545411 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.545499 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.545723 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.545808 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.546208 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.546328 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.546414 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.546502 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.546681 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.546770 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.547013 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.547174 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.547317 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.547438 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.547630 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.547757 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.547947 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.548043 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.548268 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.548412 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.548582 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.548674 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.548893 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.549001 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.549225 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.549314 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.549579 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.549734 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.549893 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.550070 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.550223 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.550314 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.550535 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.550639 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.550854 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.550974 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.551167 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.551271 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.551493 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.551657 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.551806 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.551900 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.552126 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.552215 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.552441 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.552547 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.552772 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.552873 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.553097 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.553205 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.553447 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.553563 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.553758 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.553873 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.554135 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.554279 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.554500 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.554597 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.554777 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.554927 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.555092 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.555240 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.555396 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.555535 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:46:11.555678 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 14:46:11.555834 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 14:46:11.614983 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO dbcounter [None req-6aa91788-9aae-4f07-8d43-eeda6ac6309b None None] Registered counter for database nova_api May 25 14:46:11.615249 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO dbcounter [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] Registered counter for database nova_api May 25 14:46:11.637309 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG oslo_db.sqlalchemy.engines [None req-6aa91788-9aae-4f07-8d43-eeda6ac6309b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:46:11.640181 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_db.sqlalchemy.engines [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:46:11.645124 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writer thread running {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:46:11.649929 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writer thread running {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:46:11.705148 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.context [None req-6aa91788-9aae-4f07-8d43-eeda6ac6309b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f226ac9f-7602-4f04-9db9-a539f668d3bc(cell1) {{(pid=109607) load_cells /opt/stack/nova/nova/context.py:464}} May 25 14:46:11.709983 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG oslo_concurrency.lockutils [None req-6aa91788-9aae-4f07-8d43-eeda6ac6309b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:46:11.711688 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG oslo_concurrency.lockutils [None req-6aa91788-9aae-4f07-8d43-eeda6ac6309b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:46:11.712502 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG oslo_concurrency.lockutils [None req-6aa91788-9aae-4f07-8d43-eeda6ac6309b None None] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:46:11.714567 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG oslo_concurrency.lockutils [None req-6aa91788-9aae-4f07-8d43-eeda6ac6309b None None] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:46:11.716636 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO dbcounter [None req-6aa91788-9aae-4f07-8d43-eeda6ac6309b None None] Registered counter for database nova_cell0 May 25 14:46:11.720660 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.context [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f226ac9f-7602-4f04-9db9-a539f668d3bc(cell1) {{(pid=109606) load_cells /opt/stack/nova/nova/context.py:464}} May 25 14:46:11.720962 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO dbcounter [None req-6aa91788-9aae-4f07-8d43-eeda6ac6309b None None] Registered counter for database nova_cell1 May 25 14:46:11.725649 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:46:11.727376 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:46:11.728236 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:46:11.730368 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG oslo_db.sqlalchemy.engines [None req-6aa91788-9aae-4f07-8d43-eeda6ac6309b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:46:11.730531 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:46:11.732512 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO dbcounter [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] Registered counter for database nova_cell0 May 25 14:46:11.732859 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG oslo_db.sqlalchemy.engines [None req-6aa91788-9aae-4f07-8d43-eeda6ac6309b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:46:11.736900 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO dbcounter [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] Registered counter for database nova_cell1 May 25 14:46:11.739810 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writer thread running {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:46:11.745509 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_db.sqlalchemy.engines [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:46:11.747897 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_db.sqlalchemy.engines [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:46:11.759959 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writer thread running {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:46:11.762162 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writer thread running {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:46:11.905888 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writer thread running {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:46:11.916050 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO dbcounter [None req-6aa91788-9aae-4f07-8d43-eeda6ac6309b None None] Registered counter for database nova_cell0 May 25 14:46:11.925784 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG oslo_db.sqlalchemy.engines [None req-6aa91788-9aae-4f07-8d43-eeda6ac6309b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:46:11.932309 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writer thread running {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:46:11.949483 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO dbcounter [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] Registered counter for database nova_cell0 May 25 14:46:11.960336 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_db.sqlalchemy.engines [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:46:11.965574 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writer thread running {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:46:12.290917 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: WARNING keystonemiddleware.auth_token [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 14:46:12.298407 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: WARNING keystonemiddleware.auth_token [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 14:46:12.322843 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: WARNING keystonemiddleware.auth_token [None req-6aa91788-9aae-4f07-8d43-eeda6ac6309b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 14:46:12.332432 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: WARNING keystonemiddleware.auth_token [None req-6aa91788-9aae-4f07-8d43-eeda6ac6309b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 14:46:12.647319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: WARNING keystonemiddleware.auth_token [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 14:46:12.654212 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: WARNING keystonemiddleware.auth_token [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 14:46:12.659823 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56359dabb9c0 pid: 109606 (default app) May 25 14:46:12.662081 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:46:12.663311 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001929 May 25 14:46:12.663733 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 788 bytes} [Wed May 25 14:46:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:46:12.726284 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: WARNING keystonemiddleware.auth_token [None req-6aa91788-9aae-4f07-8d43-eeda6ac6309b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 14:46:12.732581 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: WARNING keystonemiddleware.auth_token [None req-6aa91788-9aae-4f07-8d43-eeda6ac6309b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 14:46:12.738798 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56359dabb9c0 pid: 109607 (default app) May 25 14:47:40.674880 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:40.677798 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003440 May 25 14:47:40.678340 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 2/2] 10.222.0.78 () {54 vars in 930 bytes} [Wed May 25 14:47:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:40.696700 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writing DB stats nova_api:SELECT=3 {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:40.698551 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writing DB stats nova_cell0:SELECT=3 {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:40.699963 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writing DB stats nova_cell1:SELECT=3 {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:40.700889 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:41.191989 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-43a9fb2d-a7a7-4299-bb1d-e7201c798b73 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:41.226381 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-43a9fb2d-a7a7-4299-bb1d-e7201c798b73 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.540200 May 25 14:47:41.227233 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 1/3] 10.222.0.78 () {60 vars in 1291 bytes} [Wed May 25 14:47:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:47:43.623243 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:43.624258 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-30da3f1c-79e0-4667-a373-eb4086c4e904 None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 25 14:47:43.625043 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 3/4] 10.222.0.78 () {54 vars in 930 bytes} [Wed May 25 14:47:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:43.692585 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-d6c0500b-9062-4500-844d-af85a731c941 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 256, "swap": 0, "name": "cirros256", "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:43.711198 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:47:43.711198 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: warnings.warn(msg) May 25 14:47:43.742463 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-d6c0500b-9062-4500-844d-af85a731c941 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.110172 May 25 14:47:43.750126 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 2/5] 10.222.0.78 () {64 vars in 1282 bytes} [Wed May 25 14:47:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:47:43.757378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_api:SELECT=3 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:43.759353 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_cell0:SELECT=3 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:43.761008 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_cell1:SELECT=3 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:43.761462 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_cell0:SELECT=3 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:43.976513 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-fd94b021-b404-4d69-a6a9-ce01ddf59e5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:43.979038 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:47:43.979038 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: warnings.warn(msg) May 25 14:47:44.046056 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-fd94b021-b404-4d69-a6a9-ce01ddf59e5c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294407 May 25 14:47:44.047034 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 4/6] 10.222.0.78 () {64 vars in 1335 bytes} [Wed May 25 14:47:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:47:46.376199 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-d6c0500b-9062-4500-844d-af85a731c941 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:46.377240 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-d6c0500b-9062-4500-844d-af85a731c941 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 25 14:47:46.377651 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 3/7] 10.222.0.78 () {54 vars in 930 bytes} [Wed May 25 14:47:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:46.494262 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-0880fbb5-b349-41c0-a5c6-811e6568807d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "swap": 0}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:46.512096 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:47:46.512096 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: warnings.warn(msg) May 25 14:47:46.535500 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-0880fbb5-b349-41c0-a5c6-811e6568807d admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.151027 May 25 14:47:46.536278 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 5/8] 10.222.0.78 () {64 vars in 1282 bytes} [Wed May 25 14:47:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:47:46.547934 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-b2066fac-2972-40ae-8f59-16f7959f40f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:46.549431 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:47:46.549431 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: warnings.warn(msg) May 25 14:47:46.585308 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-b2066fac-2972-40ae-8f59-16f7959f40f4 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040937 May 25 14:47:46.586062 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 4/9] 10.222.0.78 () {64 vars in 1335 bytes} [Wed May 25 14:47:46 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:47:48.900017 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-0880fbb5-b349-41c0-a5c6-811e6568807d admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:48.901660 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-0880fbb5-b349-41c0-a5c6-811e6568807d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002138 May 25 14:47:48.906410 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 6/10] 10.222.0.78 () {54 vars in 930 bytes} [Wed May 25 14:47:48 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:48.963928 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-e06e33d0-4138-470c-a6f3-4372afec352b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "disk": 10, "vcpus": 1}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:48.984102 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-e06e33d0-4138-470c-a6f3-4372afec352b admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074495 May 25 14:47:48.985659 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 5/11] 10.222.0.78 () {64 vars in 1282 bytes} [Wed May 25 14:47:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:47:48.997046 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-5cea01e8-6e76-44a1-a722-c36736cfcb73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:49.022881 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-5cea01e8-6e76-44a1-a722-c36736cfcb73 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029474 May 25 14:47:49.024483 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 7/12] 10.222.0.78 () {64 vars in 1335 bytes} [Wed May 25 14:47:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:47:51.332609 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-e06e33d0-4138-470c-a6f3-4372afec352b admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:51.333634 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-e06e33d0-4138-470c-a6f3-4372afec352b admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 25 14:47:51.334192 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 6/13] 10.222.0.78 () {54 vars in 930 bytes} [Wed May 25 14:47:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:51.394647 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-622b0ea9-e388-4ea2-9d24-64587ad0a126 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:51.413014 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-622b0ea9-e388-4ea2-9d24-64587ad0a126 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072829 May 25 14:47:51.413529 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 8/14] 10.222.0.78 () {64 vars in 1282 bytes} [Wed May 25 14:47:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:47:51.426146 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-fafbee08-bf5b-43b9-adaa-37f3aa0b4b5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:51.449157 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-fafbee08-bf5b-43b9-adaa-37f3aa0b4b5b admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027555 May 25 14:47:51.449750 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 7/15] 10.222.0.78 () {64 vars in 1335 bytes} [Wed May 25 14:47:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:47:53.777581 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-622b0ea9-e388-4ea2-9d24-64587ad0a126 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:53.778693 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-622b0ea9-e388-4ea2-9d24-64587ad0a126 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 May 25 14:47:53.779118 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 9/16] 10.222.0.78 () {54 vars in 930 bytes} [Wed May 25 14:47:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:53.847924 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-dd73d427-7a93-498d-ae73-4fe923ab366b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "id": "d4", "vcpus": 4}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:53.865530 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-dd73d427-7a93-498d-ae73-4fe923ab366b admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079370 May 25 14:47:53.866118 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 8/17] 10.222.0.78 () {64 vars in 1282 bytes} [Wed May 25 14:47:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:47:53.878808 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-a00cc4fb-ded7-46a7-9777-e18a48e96cc0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:53.903135 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-a00cc4fb-ded7-46a7-9777-e18a48e96cc0 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028665 May 25 14:47:53.903799 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 10/18] 10.222.0.78 () {64 vars in 1335 bytes} [Wed May 25 14:47:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:47:56.225868 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-dd73d427-7a93-498d-ae73-4fe923ab366b admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:56.226929 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-dd73d427-7a93-498d-ae73-4fe923ab366b admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 25 14:47:56.227337 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 9/19] 10.222.0.78 () {54 vars in 930 bytes} [Wed May 25 14:47:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:56.288577 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-b28b9857-7f68-4285-9a09-e39dd49d88e8 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:56.312518 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-b28b9857-7f68-4285-9a09-e39dd49d88e8 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078782 May 25 14:47:56.313414 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 11/20] 10.222.0.78 () {60 vars in 1291 bytes} [Wed May 25 14:47:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:47:58.743963 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-dd73d427-7a93-498d-ae73-4fe923ab366b admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:58.745232 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-dd73d427-7a93-498d-ae73-4fe923ab366b admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001797 May 25 14:47:58.745714 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 10/21] 10.222.0.78 () {54 vars in 930 bytes} [Wed May 25 14:47:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:47:58.816960 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-2d08e8db-49e9-4592-8882-ffecb9ee16ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "disk": 1, "name": "m1.tiny"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:58.838192 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-2d08e8db-49e9-4592-8882-ffecb9ee16ad admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.085020 May 25 14:47:58.838769 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 12/22] 10.222.0.78 () {64 vars in 1282 bytes} [Wed May 25 14:47:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 14:47:58.853984 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-a973afb0-2a6b-4fb4-8b1a-56c90e97879a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:58.882640 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-a973afb0-2a6b-4fb4-8b1a-56c90e97879a admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032730 May 25 14:47:58.883270 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 11/23] 10.222.0.78 () {64 vars in 1332 bytes} [Wed May 25 14:47:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:48:01.400628 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-2d08e8db-49e9-4592-8882-ffecb9ee16ad admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:01.401776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-2d08e8db-49e9-4592-8882-ffecb9ee16ad admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 May 25 14:48:01.402589 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 13/24] 10.222.0.78 () {54 vars in 930 bytes} [Wed May 25 14:48:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:48:01.486077 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-c2ec9869-af9d-4cf3-961b-42214759e2fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "id": "2", "disk": 20}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:48:01.509987 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-c2ec9869-af9d-4cf3-961b-42214759e2fc admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.100001 May 25 14:48:01.510998 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 12/25] 10.222.0.78 () {64 vars in 1282 bytes} [Wed May 25 14:48:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:48:01.528161 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-a3dea30c-449a-404f-88d7-d607350b2704 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:48:01.563177 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-a3dea30c-449a-404f-88d7-d607350b2704 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040727 May 25 14:48:01.564026 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 14/26] 10.222.0.78 () {64 vars in 1332 bytes} [Wed May 25 14:48:01 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:48:04.634952 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-c2ec9869-af9d-4cf3-961b-42214759e2fc admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:04.636612 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-c2ec9869-af9d-4cf3-961b-42214759e2fc admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002085 May 25 14:48:04.637192 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 13/27] 10.222.0.78 () {54 vars in 930 bytes} [Wed May 25 14:48:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:48:04.699920 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-eb4fe2f6-d712-4b98-a2b4-132806958a33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:48:04.719014 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-eb4fe2f6-d712-4b98-a2b4-132806958a33 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075625 May 25 14:48:04.719574 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 15/28] 10.222.0.78 () {64 vars in 1282 bytes} [Wed May 25 14:48:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:48:04.735331 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-fa639032-9392-4064-8b8e-54ff95bd563c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:48:04.759402 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-fa639032-9392-4064-8b8e-54ff95bd563c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027809 May 25 14:48:04.759992 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 14/29] 10.222.0.78 () {64 vars in 1332 bytes} [Wed May 25 14:48:04 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:48:07.296431 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-eb4fe2f6-d712-4b98-a2b4-132806958a33 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:07.298176 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-eb4fe2f6-d712-4b98-a2b4-132806958a33 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002260 May 25 14:48:07.298847 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 16/30] 10.222.0.78 () {54 vars in 930 bytes} [Wed May 25 14:48:07 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:48:07.377435 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-3745dcd3-a735-4f43-9a5f-a2eb73bcf9da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "ram": 8192, "disk": 80}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:48:07.400253 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-3745dcd3-a735-4f43-9a5f-a2eb73bcf9da admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.093999 May 25 14:48:07.401572 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 15/31] 10.222.0.78 () {64 vars in 1282 bytes} [Wed May 25 14:48:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:48:07.414986 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-b174b143-e828-4c8b-b60c-15eb692f9e51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:48:07.444747 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-b174b143-e828-4c8b-b60c-15eb692f9e51 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033372 May 25 14:48:07.446433 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 17/32] 10.222.0.78 () {64 vars in 1332 bytes} [Wed May 25 14:48:07 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:48:10.170290 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-3745dcd3-a735-4f43-9a5f-a2eb73bcf9da admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:10.174063 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-3745dcd3-a735-4f43-9a5f-a2eb73bcf9da admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002924 May 25 14:48:10.174063 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 16/33] 10.222.0.78 () {54 vars in 930 bytes} [Wed May 25 14:48:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:48:10.272255 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-37d4f2a0-abda-416a-9771-6ea0bad5615d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "id": "5"}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:48:10.303491 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-37d4f2a0-abda-416a-9771-6ea0bad5615d admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.120846 May 25 14:48:10.304189 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 18/34] 10.222.0.78 () {64 vars in 1282 bytes} [Wed May 25 14:48:10 2022] POST /compute/v2.1/flavors => generated 408 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:48:10.316949 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-3dd9e547-e38e-4bdb-87cc-4bdfd2751f05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:48:10.343658 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-3dd9e547-e38e-4bdb-87cc-4bdfd2751f05 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030949 May 25 14:48:10.344254 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 17/35] 10.222.0.78 () {64 vars in 1332 bytes} [Wed May 25 14:48:10 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:48:35.184908 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-37d4f2a0-abda-416a-9771-6ea0bad5615d admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:35.185919 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-37d4f2a0-abda-416a-9771-6ea0bad5615d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 25 14:48:35.186364 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 19/36] 10.222.0.78 () {54 vars in 930 bytes} [Wed May 25 14:48:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:48:35.197205 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:35.254065 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-711c80ef-5673-4b77-b3ae-d434904dd275 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:35.270991 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-711c80ef-5673-4b77-b3ae-d434904dd275 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.078389 May 25 14:48:35.271534 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 18/37] 10.222.0.78 () {60 vars in 1291 bytes} [Wed May 25 14:48:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:48:36.263111 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-37d4f2a0-abda-416a-9771-6ea0bad5615d admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:36.264152 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-37d4f2a0-abda-416a-9771-6ea0bad5615d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 May 25 14:48:36.264552 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 20/38] 10.222.0.78 () {56 vars in 1074 bytes} [Wed May 25 14:48:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:48:36.497875 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-bc2828b0-fd1b-4d3e-8e7f-a9487314feea admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:36.504067 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.wsgi [None req-bc2828b0-fd1b-4d3e-8e7f-a9487314feea admin admin] HTTP exception thrown: Flavor 42 could not be found. May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-bc2828b0-fd1b-4d3e-8e7f-a9487314feea admin admin] Request method failure captured: May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Accept: application/json May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Accept-Encoding: gzip, deflate May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Connection: keep-alive May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Content-Length: 0 May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Host: 10.222.0.78 May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Openstack-Api-Version: compute 2.90 May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Openstack-System-Scope: None May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: User-Agent: python-novaclient May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Auth-Token: gAAAAABijkHEwD6XaBQkB-xgxZ_Y3GGxfleLakCiC3IMT0wZHT0T5ApJ-0gXq4eLCyEHz9f7FPB_Emlxv9sBsP_85p1RVPTGxAZ7Q9TMeK_a1mTWwpidKGt5rfS9fTUhjU-45pCnM1-2J3MG59inv1VaFL2X4M7YZjfNaW3oRZljVig3C-FRGQQ May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Domain-Id: None May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Domain-Name: None May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Identity-Status: Confirmed May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Is-Admin-Project: True May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Openstack-Nova-Api-Version: 2.90 May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Project-Domain-Id: default May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Project-Domain-Name: Default May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Project-Id: 86b029bd8d8948dfab182a990de56b86 May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Project-Name: admin May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Role: admin,reader,member May 25 14:48:36.507422 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Roles: admin,reader,member May 25 14:48:36.510425 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_86b029bd8d8948dfab182a990de56b86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/86b029bd8d8948dfab182a990de56b86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/86b029bd8d8948dfab182a990de56b86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/86b029bd8d8948dfab182a990de56b86"}]}] May 25 14:48:36.510425 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Tenant: admin May 25 14:48:36.510425 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Tenant-Id: 86b029bd8d8948dfab182a990de56b86 May 25 14:48:36.510425 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Tenant-Name: admin May 25 14:48:36.510425 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-User: admin May 25 14:48:36.510425 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-User-Domain-Id: default May 25 14:48:36.510425 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-User-Domain-Name: Default May 25 14:48:36.510425 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-User-Id: f27fbbbc33b24630948a570ccae5fad0 May 25 14:48:36.510425 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-User-Name: admin May 25 14:48:36.510425 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: method: > May 25 14:48:36.510425 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: exception: Flavor 42 could not be found. May 25 14:48:36.510425 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: action_args: {'id': '42'} May 25 14:48:36.510425 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:48:36.510425 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:48:36.513614 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:48:36.515566 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:48:36.515566 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:48:36.515566 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:48:36.515566 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:48:36.515566 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 14:48:36.515566 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 14:48:36.515566 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 25 14:48:36.515566 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 25 14:48:36.515566 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:48:36.515566 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 25 14:48:36.515566 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:48:36.515566 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:48:36.515566 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:48:36.515566 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:48:36.515566 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:48:36.515566 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 25 14:48:36.515566 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 25 14:48:36.515566 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-bc2828b0-fd1b-4d3e-8e7f-a9487314feea admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:48:36.517026 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-bc2828b0-fd1b-4d3e-8e7f-a9487314feea admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.065791 May 25 14:48:36.517026 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 19/39] 10.222.0.78 () {60 vars in 1190 bytes} [Wed May 25 14:48:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 14:48:36.519386 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-2f830828-a080-4321-8925-2599ca125c49 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:36.522408 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:36.543062 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-2f830828-a080-4321-8925-2599ca125c49 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027252 May 25 14:48:36.543623 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 21/40] 10.222.0.78 () {60 vars in 1210 bytes} [Wed May 25 14:48:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:48:36.553924 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-d04da051-8fd1-4ec0-9c1b-a001b772b388 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:36.574920 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-d04da051-8fd1-4ec0-9c1b-a001b772b388 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025109 May 25 14:48:36.575471 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 20/41] 10.222.0.78 () {60 vars in 1210 bytes} [Wed May 25 14:48:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:48:36.585127 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-1ba4a666-12a6-41bc-93bf-591b6d5f04bd admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:36.592199 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.wsgi [None req-1ba4a666-12a6-41bc-93bf-591b6d5f04bd admin admin] HTTP exception thrown: Flavor 42 could not be found. May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-1ba4a666-12a6-41bc-93bf-591b6d5f04bd admin admin] Request method failure captured: May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Accept: application/json May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Accept-Encoding: gzip, deflate May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Connection: keep-alive May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Content-Length: 0 May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Host: 10.222.0.78 May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Openstack-Api-Version: compute 2.90 May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Openstack-System-Scope: None May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: User-Agent: python-novaclient May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Auth-Token: gAAAAABijkHEwD6XaBQkB-xgxZ_Y3GGxfleLakCiC3IMT0wZHT0T5ApJ-0gXq4eLCyEHz9f7FPB_Emlxv9sBsP_85p1RVPTGxAZ7Q9TMeK_a1mTWwpidKGt5rfS9fTUhjU-45pCnM1-2J3MG59inv1VaFL2X4M7YZjfNaW3oRZljVig3C-FRGQQ May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Domain-Id: None May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Domain-Name: None May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Identity-Status: Confirmed May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Is-Admin-Project: True May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Openstack-Nova-Api-Version: 2.90 May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Project-Domain-Id: default May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Project-Domain-Name: Default May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Project-Id: 86b029bd8d8948dfab182a990de56b86 May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Project-Name: admin May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Role: admin,reader,member May 25 14:48:36.595659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Roles: admin,reader,member May 25 14:48:36.597530 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_86b029bd8d8948dfab182a990de56b86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/86b029bd8d8948dfab182a990de56b86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/86b029bd8d8948dfab182a990de56b86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/86b029bd8d8948dfab182a990de56b86"}]}] May 25 14:48:36.597530 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Tenant: admin May 25 14:48:36.597530 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Tenant-Id: 86b029bd8d8948dfab182a990de56b86 May 25 14:48:36.597530 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Tenant-Name: admin May 25 14:48:36.597530 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-User: admin May 25 14:48:36.597530 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-User-Domain-Id: default May 25 14:48:36.597530 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-User-Domain-Name: Default May 25 14:48:36.597530 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-User-Id: f27fbbbc33b24630948a570ccae5fad0 May 25 14:48:36.597530 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-User-Name: admin May 25 14:48:36.597530 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: method: > May 25 14:48:36.597530 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: exception: Flavor 42 could not be found. May 25 14:48:36.597530 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: action_args: {'id': '42'} May 25 14:48:36.597530 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:48:36.597530 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:48:36.598348 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:48:36.599651 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:48:36.599651 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:48:36.599651 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:48:36.599651 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:48:36.599651 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 14:48:36.599651 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 14:48:36.599651 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 25 14:48:36.599651 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 25 14:48:36.599651 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:48:36.599651 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 25 14:48:36.599651 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:48:36.599651 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:48:36.599651 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:48:36.599651 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:48:36.599651 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:48:36.599651 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 25 14:48:36.599651 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 25 14:48:36.599651 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-1ba4a666-12a6-41bc-93bf-591b6d5f04bd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:48:36.600856 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-1ba4a666-12a6-41bc-93bf-591b6d5f04bd admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016321 May 25 14:48:36.600856 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 22/42] 10.222.0.78 () {60 vars in 1190 bytes} [Wed May 25 14:48:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 14:48:37.482693 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-d04da051-8fd1-4ec0-9c1b-a001b772b388 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:37.483734 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-d04da051-8fd1-4ec0-9c1b-a001b772b388 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 May 25 14:48:37.484127 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 21/43] 10.222.0.78 () {56 vars in 1074 bytes} [Wed May 25 14:48:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:48:37.681935 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-2540f482-0374-4427-8656-b3015cd77e61 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:37.687824 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.wsgi [None req-2540f482-0374-4427-8656-b3015cd77e61 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-2540f482-0374-4427-8656-b3015cd77e61 admin admin] Request method failure captured: May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Accept: application/json May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Accept-Encoding: gzip, deflate May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Connection: keep-alive May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Content-Length: 0 May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Host: 10.222.0.78 May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Openstack-Api-Version: compute 2.90 May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Openstack-System-Scope: None May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: User-Agent: python-novaclient May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Auth-Token: gAAAAABijkHF7XTgxyac2zvj-myWImcpMryEum5LDvAR-2dp5ZNflx7lCBve97iLAjO_H0Yw7zVaf0zQi39nbKMjpUvLAdcAhAP8AY8elKrfINjsLaVRfnQxqTDmEm2ssUlnKT7rSJFhI6qN4giIsVt4UeOlVNQUzV5yaUN-tSFcejGuw-kx2ZA May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Domain-Id: None May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Domain-Name: None May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Identity-Status: Confirmed May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Is-Admin-Project: True May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Openstack-Nova-Api-Version: 2.90 May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Project-Domain-Id: default May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Project-Domain-Name: Default May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Project-Id: 86b029bd8d8948dfab182a990de56b86 May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Project-Name: admin May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Role: admin,reader,member May 25 14:48:37.689378 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Roles: admin,reader,member May 25 14:48:37.691491 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_86b029bd8d8948dfab182a990de56b86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/86b029bd8d8948dfab182a990de56b86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/86b029bd8d8948dfab182a990de56b86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/86b029bd8d8948dfab182a990de56b86"}]}] May 25 14:48:37.691491 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Tenant: admin May 25 14:48:37.691491 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Tenant-Id: 86b029bd8d8948dfab182a990de56b86 May 25 14:48:37.691491 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Tenant-Name: admin May 25 14:48:37.691491 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-User: admin May 25 14:48:37.691491 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-User-Domain-Id: default May 25 14:48:37.691491 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-User-Domain-Name: Default May 25 14:48:37.691491 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-User-Id: f27fbbbc33b24630948a570ccae5fad0 May 25 14:48:37.691491 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-User-Name: admin May 25 14:48:37.691491 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: method: > May 25 14:48:37.691491 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: exception: Flavor 84 could not be found. May 25 14:48:37.691491 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: action_args: {'id': '84'} May 25 14:48:37.691491 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:48:37.691491 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:48:37.692472 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:48:37.693776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:48:37.693776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:48:37.693776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:48:37.693776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:48:37.693776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 14:48:37.693776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 14:48:37.693776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 25 14:48:37.693776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 25 14:48:37.693776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:48:37.693776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 25 14:48:37.693776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:48:37.693776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:48:37.693776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:48:37.693776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:48:37.693776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:48:37.693776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 25 14:48:37.693776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 25 14:48:37.693776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-2540f482-0374-4427-8656-b3015cd77e61 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:48:37.695011 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-2540f482-0374-4427-8656-b3015cd77e61 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062285 May 25 14:48:37.695011 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 23/44] 10.222.0.78 () {60 vars in 1190 bytes} [Wed May 25 14:48:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 14:48:37.701196 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-1e7d2e9a-6b98-4340-99af-f43aecddc01e admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:37.716433 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-1e7d2e9a-6b98-4340-99af-f43aecddc01e admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018798 May 25 14:48:37.716975 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 22/45] 10.222.0.78 () {60 vars in 1210 bytes} [Wed May 25 14:48:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:48:37.726397 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-e65ae12e-1dbe-467b-99ff-c8092c76dd43 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:37.740468 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-e65ae12e-1dbe-467b-99ff-c8092c76dd43 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017536 May 25 14:48:37.741000 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 24/46] 10.222.0.78 () {60 vars in 1210 bytes} [Wed May 25 14:48:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:48:37.750325 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-d31f9602-2a5e-46f6-975e-fd18a3d109ce admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:37.756349 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.wsgi [None req-d31f9602-2a5e-46f6-975e-fd18a3d109ce admin admin] HTTP exception thrown: Flavor 84 could not be found. May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-d31f9602-2a5e-46f6-975e-fd18a3d109ce admin admin] Request method failure captured: May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Accept: application/json May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Accept-Encoding: gzip, deflate May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Connection: keep-alive May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Content-Length: 0 May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Host: 10.222.0.78 May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Openstack-Api-Version: compute 2.90 May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Openstack-System-Scope: None May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: User-Agent: python-novaclient May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Auth-Token: gAAAAABijkHF7XTgxyac2zvj-myWImcpMryEum5LDvAR-2dp5ZNflx7lCBve97iLAjO_H0Yw7zVaf0zQi39nbKMjpUvLAdcAhAP8AY8elKrfINjsLaVRfnQxqTDmEm2ssUlnKT7rSJFhI6qN4giIsVt4UeOlVNQUzV5yaUN-tSFcejGuw-kx2ZA May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Domain-Id: None May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Domain-Name: None May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Identity-Status: Confirmed May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Is-Admin-Project: True May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Openstack-Nova-Api-Version: 2.90 May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Project-Domain-Id: default May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Project-Domain-Name: Default May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Project-Id: 86b029bd8d8948dfab182a990de56b86 May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Project-Name: admin May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Role: admin,reader,member May 25 14:48:37.757854 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Roles: admin,reader,member May 25 14:48:37.759378 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_86b029bd8d8948dfab182a990de56b86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/86b029bd8d8948dfab182a990de56b86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/86b029bd8d8948dfab182a990de56b86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/86b029bd8d8948dfab182a990de56b86"}]}] May 25 14:48:37.759378 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Tenant: admin May 25 14:48:37.759378 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Tenant-Id: 86b029bd8d8948dfab182a990de56b86 May 25 14:48:37.759378 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Tenant-Name: admin May 25 14:48:37.759378 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-User: admin May 25 14:48:37.759378 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-User-Domain-Id: default May 25 14:48:37.759378 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-User-Domain-Name: Default May 25 14:48:37.759378 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-User-Id: f27fbbbc33b24630948a570ccae5fad0 May 25 14:48:37.759378 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-User-Name: admin May 25 14:48:37.759378 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: method: > May 25 14:48:37.759378 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: exception: Flavor 84 could not be found. May 25 14:48:37.759378 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: action_args: {'id': '84'} May 25 14:48:37.759378 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:48:37.759378 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:48:37.760307 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:48:37.761391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:48:37.761391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:48:37.761391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:48:37.761391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:48:37.761391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 14:48:37.761391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 14:48:37.761391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 25 14:48:37.761391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 25 14:48:37.761391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:48:37.761391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 25 14:48:37.761391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:48:37.761391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:48:37.761391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:48:37.761391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:48:37.761391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:48:37.761391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 25 14:48:37.761391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 25 14:48:37.761391 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-d31f9602-2a5e-46f6-975e-fd18a3d109ce admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:48:37.762424 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-d31f9602-2a5e-46f6-975e-fd18a3d109ce admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012640 May 25 14:48:37.762424 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 23/47] 10.222.0.78 () {60 vars in 1190 bytes} [Wed May 25 14:48:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 25 14:48:38.639093 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-e65ae12e-1dbe-467b-99ff-c8092c76dd43 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:38.640090 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-e65ae12e-1dbe-467b-99ff-c8092c76dd43 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 May 25 14:48:38.640484 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 25/48] 10.222.0.78 () {56 vars in 1074 bytes} [Wed May 25 14:48:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:48:38.830390 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-932db230-2ff6-4f78-a087-34d8fd45f468 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:38.836960 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.wsgi [None req-932db230-2ff6-4f78-a087-34d8fd45f468 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-932db230-2ff6-4f78-a087-34d8fd45f468 admin admin] Request method failure captured: May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Accept: application/json May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Accept-Encoding: gzip, deflate May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Connection: keep-alive May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Content-Length: 0 May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Host: 10.222.0.78 May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Openstack-Api-Version: compute 2.90 May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Openstack-System-Scope: None May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: User-Agent: python-novaclient May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Auth-Token: gAAAAABijkHGxX1-5yLym8uA56cWqY5Rtawyhquyc4ig0A-RS_si0dujgtJjX8voZeAd5ZxExiPWoMesAzJRJoFmyMCYmqQ0RVL-sZt_cakRv20LO7m34-TMrNGVQU7G2mR2V4HOko5kHlFkutOBHONEVkUinji75DUhYe7olX7JRDubkUxB7T4 May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Domain-Id: None May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Domain-Name: None May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Identity-Status: Confirmed May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Is-Admin-Project: True May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Openstack-Nova-Api-Version: 2.90 May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Project-Domain-Id: default May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Project-Domain-Name: Default May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Project-Id: 86b029bd8d8948dfab182a990de56b86 May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Project-Name: admin May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Role: admin,reader,member May 25 14:48:38.838538 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Roles: admin,reader,member May 25 14:48:38.840167 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_86b029bd8d8948dfab182a990de56b86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/86b029bd8d8948dfab182a990de56b86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/86b029bd8d8948dfab182a990de56b86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/86b029bd8d8948dfab182a990de56b86"}]}] May 25 14:48:38.840167 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Tenant: admin May 25 14:48:38.840167 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Tenant-Id: 86b029bd8d8948dfab182a990de56b86 May 25 14:48:38.840167 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-Tenant-Name: admin May 25 14:48:38.840167 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-User: admin May 25 14:48:38.840167 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-User-Domain-Id: default May 25 14:48:38.840167 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-User-Domain-Name: Default May 25 14:48:38.840167 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-User-Id: f27fbbbc33b24630948a570ccae5fad0 May 25 14:48:38.840167 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: X-User-Name: admin May 25 14:48:38.840167 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: method: > May 25 14:48:38.840167 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: exception: Flavor 451 could not be found. May 25 14:48:38.840167 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: action_args: {'id': '451'} May 25 14:48:38.840167 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:48:38.840167 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:48:38.841321 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:48:38.842584 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:48:38.842584 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:48:38.842584 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:48:38.842584 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:48:38.842584 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 14:48:38.842584 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 14:48:38.842584 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 25 14:48:38.842584 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 25 14:48:38.842584 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:48:38.842584 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 25 14:48:38.842584 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:48:38.842584 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:48:38.842584 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:48:38.842584 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:48:38.842584 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:48:38.842584 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 25 14:48:38.842584 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: ERROR nova.api.openstack.wsgi May 25 14:48:38.842584 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-932db230-2ff6-4f78-a087-34d8fd45f468 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:48:38.843682 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-932db230-2ff6-4f78-a087-34d8fd45f468 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063375 May 25 14:48:38.843682 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 24/49] 10.222.0.78 () {60 vars in 1193 bytes} [Wed May 25 14:48:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 14:48:38.850264 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-a8167c2d-a75c-41f4-9707-15d4e6e94f3f admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:38.866102 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-a8167c2d-a75c-41f4-9707-15d4e6e94f3f admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019830 May 25 14:48:38.866680 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 26/50] 10.222.0.78 () {60 vars in 1210 bytes} [Wed May 25 14:48:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:48:38.876426 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-43199aa6-5f16-4572-bae1-9098eb9a4930 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:38.890424 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-43199aa6-5f16-4572-bae1-9098eb9a4930 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017506 May 25 14:48:38.890994 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 25/51] 10.222.0.78 () {60 vars in 1210 bytes} [Wed May 25 14:48:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:48:38.900869 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-627cb09f-ce89-4cf7-9d46-e45842b67cd2 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:38.907298 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.wsgi [None req-627cb09f-ce89-4cf7-9d46-e45842b67cd2 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-627cb09f-ce89-4cf7-9d46-e45842b67cd2 admin admin] Request method failure captured: May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Accept: application/json May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Accept-Encoding: gzip, deflate May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Connection: keep-alive May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Content-Length: 0 May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Host: 10.222.0.78 May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Openstack-Api-Version: compute 2.90 May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Openstack-System-Scope: None May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: User-Agent: python-novaclient May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Auth-Token: gAAAAABijkHGxX1-5yLym8uA56cWqY5Rtawyhquyc4ig0A-RS_si0dujgtJjX8voZeAd5ZxExiPWoMesAzJRJoFmyMCYmqQ0RVL-sZt_cakRv20LO7m34-TMrNGVQU7G2mR2V4HOko5kHlFkutOBHONEVkUinji75DUhYe7olX7JRDubkUxB7T4 May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Domain-Id: None May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Domain-Name: None May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Identity-Status: Confirmed May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Is-Admin-Project: True May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Openstack-Nova-Api-Version: 2.90 May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Project-Domain-Id: default May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Project-Domain-Name: Default May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Project-Id: 86b029bd8d8948dfab182a990de56b86 May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Project-Name: admin May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Role: admin,reader,member May 25 14:48:38.909319 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Roles: admin,reader,member May 25 14:48:38.910873 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_86b029bd8d8948dfab182a990de56b86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/86b029bd8d8948dfab182a990de56b86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/86b029bd8d8948dfab182a990de56b86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/86b029bd8d8948dfab182a990de56b86"}]}] May 25 14:48:38.910873 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Tenant: admin May 25 14:48:38.910873 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Tenant-Id: 86b029bd8d8948dfab182a990de56b86 May 25 14:48:38.910873 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-Tenant-Name: admin May 25 14:48:38.910873 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-User: admin May 25 14:48:38.910873 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-User-Domain-Id: default May 25 14:48:38.910873 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-User-Domain-Name: Default May 25 14:48:38.910873 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-User-Id: f27fbbbc33b24630948a570ccae5fad0 May 25 14:48:38.910873 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: X-User-Name: admin May 25 14:48:38.910873 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: method: > May 25 14:48:38.910873 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: exception: Flavor 451 could not be found. May 25 14:48:38.910873 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: action_args: {'id': '451'} May 25 14:48:38.910873 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:48:38.910873 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:48:38.911691 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:48:38.912829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:48:38.912829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:48:38.912829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:48:38.912829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:48:38.912829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 14:48:38.912829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 14:48:38.912829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 25 14:48:38.912829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 25 14:48:38.912829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:48:38.912829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 25 14:48:38.912829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:48:38.912829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:48:38.912829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:48:38.912829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:48:38.912829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:48:38.912829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 25 14:48:38.912829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: ERROR nova.api.openstack.wsgi May 25 14:48:38.912829 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-627cb09f-ce89-4cf7-9d46-e45842b67cd2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:48:38.913811 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-627cb09f-ce89-4cf7-9d46-e45842b67cd2 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013569 May 25 14:48:38.913811 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 27/52] 10.222.0.78 () {60 vars in 1193 bytes} [Wed May 25 14:48:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 14:48:39.813314 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-43199aa6-5f16-4572-bae1-9098eb9a4930 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:39.814368 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-43199aa6-5f16-4572-bae1-9098eb9a4930 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 25 14:48:39.814799 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 26/53] 10.222.0.78 () {56 vars in 1074 bytes} [Wed May 25 14:48:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:48:40.009201 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-d5d34209-3e63-4254-8d81-96a898f911a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:48:40.040021 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-d5d34209-3e63-4254-8d81-96a898f911a2 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.084551 May 25 14:48:40.040480 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 28/54] 10.222.0.78 () {64 vars in 1235 bytes} [Wed May 25 14:48:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:48:40.936339 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-43199aa6-5f16-4572-bae1-9098eb9a4930 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:40.937346 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-43199aa6-5f16-4572-bae1-9098eb9a4930 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 25 14:48:40.937757 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 27/55] 10.222.0.78 () {56 vars in 1074 bytes} [Wed May 25 14:48:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:48:41.129626 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-008d52ed-68a4-48d5-b6f6-aadcb58d36e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:48:41.148085 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-008d52ed-68a4-48d5-b6f6-aadcb58d36e5 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071583 May 25 14:48:41.148560 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 29/56] 10.222.0.78 () {64 vars in 1235 bytes} [Wed May 25 14:48:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:48:42.034032 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-43199aa6-5f16-4572-bae1-9098eb9a4930 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:42.035058 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-43199aa6-5f16-4572-bae1-9098eb9a4930 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 25 14:48:42.035462 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 28/57] 10.222.0.78 () {56 vars in 1074 bytes} [Wed May 25 14:48:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:48:42.228427 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-b1a7b735-00c5-43bb-a135-2100fe08dee7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:48:42.246878 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-b1a7b735-00c5-43bb-a135-2100fe08dee7 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.072762 May 25 14:48:42.247747 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 30/58] 10.222.0.78 () {64 vars in 1235 bytes} [Wed May 25 14:48:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:48:43.122913 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-43199aa6-5f16-4572-bae1-9098eb9a4930 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:43.123959 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-43199aa6-5f16-4572-bae1-9098eb9a4930 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 25 14:48:43.124364 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 29/59] 10.222.0.78 () {56 vars in 1074 bytes} [Wed May 25 14:48:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:48:43.320958 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-4eeb4f53-1e6e-4b3c-9d4e-2f3b793cd303 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:48:43.344666 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-4eeb4f53-1e6e-4b3c-9d4e-2f3b793cd303 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.080828 May 25 14:48:43.345220 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 31/60] 10.222.0.78 () {64 vars in 1235 bytes} [Wed May 25 14:48:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 14:48:44.238457 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-43199aa6-5f16-4572-bae1-9098eb9a4930 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:44.239469 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-43199aa6-5f16-4572-bae1-9098eb9a4930 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 25 14:48:44.239876 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 30/61] 10.222.0.78 () {56 vars in 1074 bytes} [Wed May 25 14:48:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:48:44.431138 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-d1738f55-6483-482a-8aa8-ad55fea77eee admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:44.450731 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-d1738f55-6483-482a-8aa8-ad55fea77eee admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073080 May 25 14:48:44.451198 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 32/62] 10.222.0.78 () {60 vars in 1202 bytes} [Wed May 25 14:48:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:49:48.590618 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-43199aa6-5f16-4572-bae1-9098eb9a4930 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:49:48.591641 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-43199aa6-5f16-4572-bae1-9098eb9a4930 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 May 25 14:49:48.592062 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 31/63] 10.222.0.78 () {54 vars in 930 bytes} [Wed May 25 14:49:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:49:48.600379 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:48.653293 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-c4397f51-d432-42ae-a9ed-5535b3fb0c77 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:49:48.672407 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-c4397f51-d432-42ae-a9ed-5535b3fb0c77 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073627 May 25 14:49:48.672958 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 33/64] 10.222.0.78 () {60 vars in 1291 bytes} [Wed May 25 14:49:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:49:48.694003 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG dbcounter [-] [109607] Writing DB stats nova_api:SELECT=14 {{(pid=109607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:48.698133 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-899568e5-909e-4b86-a5cb-c63e1934dcf9 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:49:48.706695 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-899568e5-909e-4b86-a5cb-c63e1934dcf9 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013944 May 25 14:49:48.707221 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 32/65] 10.222.0.78 () {60 vars in 1282 bytes} [Wed May 25 14:49:48 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:49:48.718558 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-48f64339-5d86-4fd9-9aec-10d69f7fcd3c admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:49:48.726643 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-48f64339-5d86-4fd9-9aec-10d69f7fcd3c admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011617 May 25 14:49:48.727152 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 34/66] 10.222.0.78 () {60 vars in 1285 bytes} [Wed May 25 14:49:48 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:49:48.738812 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-70a412b3-aaea-4e06-b3a2-a6812940fa04 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:49:48.746466 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-70a412b3-aaea-4e06-b3a2-a6812940fa04 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011760 May 25 14:49:48.746986 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 33/67] 10.222.0.78 () {60 vars in 1285 bytes} [Wed May 25 14:49:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:49:48.759419 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-e9c319fd-7575-4a8f-9798-6744f3bbf8b8 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:49:48.767050 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-e9c319fd-7575-4a8f-9798-6744f3bbf8b8 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011156 May 25 14:49:48.767576 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 35/68] 10.222.0.78 () {60 vars in 1282 bytes} [Wed May 25 14:49:48 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:53:39.957009 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-70a412b3-aaea-4e06-b3a2-a6812940fa04 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:53:39.958053 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-70a412b3-aaea-4e06-b3a2-a6812940fa04 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 25 14:53:39.958446 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 34/69] 10.222.0.78 () {56 vars in 1074 bytes} [Wed May 25 14:53:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:53:40.128968 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_api:SELECT=6 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:40.247350 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-9557a975-0c1b-45fa-90df-4c31b53ce411 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:53:40.248526 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:53:40.248526 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: warnings.warn(msg) May 25 14:53:40.249775 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-9557a975-0c1b-45fa-90df-4c31b53ce411 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:53:40.250284 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-9557a975-0c1b-45fa-90df-4c31b53ce411 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:53:40.251044 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-9557a975-0c1b-45fa-90df-4c31b53ce411 admin admin] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:53:40.251476 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-9557a975-0c1b-45fa-90df-4c31b53ce411 admin admin] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:53:40.286200 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-9557a975-0c1b-45fa-90df-4c31b53ce411 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.158628 May 25 14:53:40.286776 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 36/70] 10.222.0.78 () {60 vars in 1193 bytes} [Wed May 25 14:53:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:53:41.174896 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-70a412b3-aaea-4e06-b3a2-a6812940fa04 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:53:41.175903 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-70a412b3-aaea-4e06-b3a2-a6812940fa04 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 25 14:53:41.176298 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 35/71] 10.222.0.78 () {56 vars in 1074 bytes} [Wed May 25 14:53:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:53:41.373745 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-c2810a8f-d2fd-4a4d-8e3b-65599101ca66 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:53:41.374948 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:53:41.374948 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: warnings.warn(msg) May 25 14:53:41.376257 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-c2810a8f-d2fd-4a4d-8e3b-65599101ca66 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:53:41.376709 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-c2810a8f-d2fd-4a4d-8e3b-65599101ca66 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:53:41.377502 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-c2810a8f-d2fd-4a4d-8e3b-65599101ca66 admin admin] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:53:41.377934 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-c2810a8f-d2fd-4a4d-8e3b-65599101ca66 admin admin] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:53:41.397812 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-c2810a8f-d2fd-4a4d-8e3b-65599101ca66 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079886 May 25 14:53:41.398412 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 37/72] 10.222.0.78 () {60 vars in 1193 bytes} [Wed May 25 14:53:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 14:53:52.685095 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-70a412b3-aaea-4e06-b3a2-a6812940fa04 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:53:52.686150 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-70a412b3-aaea-4e06-b3a2-a6812940fa04 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 25 14:53:52.686553 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 36/73] 10.222.0.78 () {56 vars in 1074 bytes} [Wed May 25 14:53:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:53:52.830808 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_cell0:SELECT=4 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:52.831505 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_cell1:SELECT=4 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:52.832113 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_api:SELECT=8 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:52.883898 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-76c02742-4fa7-4d98-b097-846b6560ba1a admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:53:52.885087 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:53:52.885087 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: warnings.warn(msg) May 25 14:53:52.886862 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-76c02742-4fa7-4d98-b097-846b6560ba1a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:53:52.887313 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-76c02742-4fa7-4d98-b097-846b6560ba1a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:53:52.888099 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-76c02742-4fa7-4d98-b097-846b6560ba1a admin admin] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:53:52.888526 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-76c02742-4fa7-4d98-b097-846b6560ba1a admin admin] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:53:52.909181 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-76c02742-4fa7-4d98-b097-846b6560ba1a admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082670 May 25 14:53:52.909751 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 38/74] 10.222.0.78 () {60 vars in 1193 bytes} [Wed May 25 14:53:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:53:53.777404 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-70a412b3-aaea-4e06-b3a2-a6812940fa04 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:53:53.778434 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-70a412b3-aaea-4e06-b3a2-a6812940fa04 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 25 14:53:53.778842 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 37/75] 10.222.0.78 () {56 vars in 1074 bytes} [Wed May 25 14:53:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:53:53.970069 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-ab8c1606-73d5-436b-8b58-dc4e0d014317 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:53:53.971239 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:53:53.971239 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: warnings.warn(msg) May 25 14:53:53.972428 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-ab8c1606-73d5-436b-8b58-dc4e0d014317 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:53:53.972874 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-ab8c1606-73d5-436b-8b58-dc4e0d014317 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:53:53.973666 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-ab8c1606-73d5-436b-8b58-dc4e0d014317 admin admin] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:53:53.974130 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-ab8c1606-73d5-436b-8b58-dc4e0d014317 admin admin] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:53:53.993924 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-ab8c1606-73d5-436b-8b58-dc4e0d014317 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075860 May 25 14:53:53.994444 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 39/76] 10.222.0.78 () {60 vars in 1193 bytes} [Wed May 25 14:53:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:54:05.273024 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-70a412b3-aaea-4e06-b3a2-a6812940fa04 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:05.274409 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-70a412b3-aaea-4e06-b3a2-a6812940fa04 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001921 May 25 14:54:05.274826 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 38/77] 10.222.0.78 () {56 vars in 1074 bytes} [Wed May 25 14:54:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:54:05.420429 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_cell0:SELECT=4 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:05.421158 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_cell1:SELECT=4 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:05.421769 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG dbcounter [-] [109606] Writing DB stats nova_api:SELECT=8 {{(pid=109606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:05.476375 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-2b51f648-102a-4fc2-a8f1-dca4526c5dfa admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:05.477659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:54:05.477659 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: warnings.warn(msg) May 25 14:54:05.478875 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-2b51f648-102a-4fc2-a8f1-dca4526c5dfa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:05.479343 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-2b51f648-102a-4fc2-a8f1-dca4526c5dfa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:05.480106 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-2b51f648-102a-4fc2-a8f1-dca4526c5dfa admin admin] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:05.480532 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-2b51f648-102a-4fc2-a8f1-dca4526c5dfa admin admin] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:05.505708 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-2b51f648-102a-4fc2-a8f1-dca4526c5dfa admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089671 May 25 14:54:05.506325 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 40/78] 10.222.0.78 () {60 vars in 1193 bytes} [Wed May 25 14:54:05 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:54:06.405801 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: DEBUG nova.api.openstack.wsgi [None req-70a412b3-aaea-4e06-b3a2-a6812940fa04 admin admin] Calling method '>' {{(pid=109607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:06.406846 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: INFO nova.api.openstack.requestlog [None req-70a412b3-aaea-4e06-b3a2-a6812940fa04 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 May 25 14:54:06.407278 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: [pid: 109607|app: 0|req: 39/79] 10.222.0.78 () {56 vars in 1074 bytes} [Wed May 25 14:54:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:54:06.599164 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG nova.api.openstack.wsgi [None req-ab62d3d3-a234-4da0-bfcb-30dbb8baaff2 admin admin] Calling method '>' {{(pid=109606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:06.600327 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:54:06.600327 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: warnings.warn(msg) May 25 14:54:06.601641 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-ab62d3d3-a234-4da0-bfcb-30dbb8baaff2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:06.602228 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-ab62d3d3-a234-4da0-bfcb-30dbb8baaff2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:06.603094 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-ab62d3d3-a234-4da0-bfcb-30dbb8baaff2 admin admin] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:06.603587 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: DEBUG oslo_concurrency.lockutils [None req-ab62d3d3-a234-4da0-bfcb-30dbb8baaff2 admin admin] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:06.625635 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: INFO nova.api.openstack.requestlog [None req-ab62d3d3-a234-4da0-bfcb-30dbb8baaff2 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080070 May 25 14:54:06.626272 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: [pid: 109606|app: 0|req: 41/80] 10.222.0.78 () {60 vars in 1193 bytes} [Wed May 25 14:54:06 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:10.289849 dv-cinder-803823-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 25 14:55:10.290703 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: Wed May 25 14:55:10 2022 - graceful shutdown triggered... May 25 14:55:10.291237 dv-cinder-803823-9-iscsi devstack@n-api.service[109606]: Gracefully killing worker 1 (pid: 109606)... May 25 14:55:10.291648 dv-cinder-803823-9-iscsi devstack@n-api.service[109607]: Gracefully killing worker 2 (pid: 109607)... May 25 14:55:11.291830 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: worker 1 buried after 1 seconds May 25 14:55:11.291830 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: worker 2 buried after 1 seconds May 25 14:55:11.292379 dv-cinder-803823-9-iscsi devstack@n-api.service[109605]: goodbye to uWSGI. May 25 14:55:11.293418 dv-cinder-803823-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 25 14:55:11.293971 dv-cinder-803823-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 25 14:55:11.296646 dv-cinder-803823-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 25 14:55:11.310038 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 25 14:55:11.320876 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 14:55:11 2022] *** May 25 14:55:11.320876 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 14:55:11.320876 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 14:55:11.320876 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: nodename: dv-cinder-803823-9-iscsi May 25 14:55:11.320876 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: machine: x86_64 May 25 14:55:11.320876 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: clock source: unix May 25 14:55:11.320876 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: pcre jit disabled May 25 14:55:11.320876 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: detected number of CPU cores: 4 May 25 14:55:11.320876 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: current working directory: / May 25 14:55:11.320876 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: detected binary path: /usr/bin/uwsgi-core May 25 14:55:11.320876 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: your processes number limit is 47680 May 25 14:55:11.321703 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: your memory page size is 4096 bytes May 25 14:55:11.321703 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: detected max file descriptor number: 2048 May 25 14:55:11.321703 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: lock engine: pthread robust mutexes May 25 14:55:11.321703 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: thunder lock: enabled May 25 14:55:11.321703 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 25 14:55:11.321703 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 14:55:11.368100 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: Python main interpreter initialized at 0x5589058f99c0 May 25 14:55:11.368100 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: python threads support enabled May 25 14:55:11.368100 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: your server socket listen backlog is limited to 100 connections May 25 14:55:11.368100 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: your mercy for graceful operations on workers is 90 seconds May 25 14:55:11.368573 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: mapped 403077 bytes (393 KB) for 2 cores May 25 14:55:11.368573 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: *** Operational MODE: preforking *** May 25 14:55:11.368818 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: *** uWSGI is running in multiple interpreter mode *** May 25 14:55:11.368818 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: spawned uWSGI master process (pid: 124510) May 25 14:55:11.369025 dv-cinder-803823-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 25 14:55:11.372444 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: spawned uWSGI worker 1 (pid: 124523, cores: 1) May 25 14:55:11.372444 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: spawned uWSGI worker 2 (pid: 124524, cores: 1) May 25 14:55:11.372444 dv-cinder-803823-9-iscsi devstack@n-api.service[124510]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 14:55:12.580099 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 14:55:12.581947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 14:55:13.433340 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:55:13.433340 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: from cryptography.utils import int_from_bytes May 25 14:55:13.433671 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:55:13.433671 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: from cryptography.utils import int_from_bytes May 25 14:55:13.436588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:55:13.436588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: from cryptography.utils import int_from_bytes May 25 14:55:13.436930 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:55:13.436930 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: from cryptography.utils import int_from_bytes May 25 14:55:15.949785 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 14:55:15.950377 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 14:55:15.950675 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 14:55:15.950979 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 14:55:15.951239 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 14:55:15.951639 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.951969 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.952296 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.952622 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.952961 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.953280 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.953656 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.953987 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.954353 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.954622 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.954956 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.955293 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-9-iscsi {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.955624 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.955941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.956258 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.956581 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.956897 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.957391 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.957709 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.958256 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.958708 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.959192 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.959670 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.960162 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.960642 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.961138 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.961461 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.961795 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.962145 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.962462 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.962890 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-9-iscsi {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.963213 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.963525 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.963843 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.964265 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.964578 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.964897 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.965226 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.965549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.965884 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.966229 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.966560 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.966890 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.967219 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.967531 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.967850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.968171 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.968500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.968809 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.969165 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.969423 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.969740 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.970094 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.970427 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.970775 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.971025 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.971286 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.971613 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.971943 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.972259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.972574 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.972891 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.973205 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.973520 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.973834 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.974176 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.974499 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.974823 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.975148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.975476 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.975791 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.976113 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.976518 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.976774 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.977087 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.977435 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.977761 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.977970 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 14:55:15.978533 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.978692 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 14:55:15.978847 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.978847 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.979127 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 14:55:15.979295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.979439 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 14:55:15.979590 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.979732 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 14:55:15.979884 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.980035 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.980177 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.980331 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.980484 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.980634 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.980811 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.980968 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.981142 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.983909 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.984109 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.984305 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.984482 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.985341 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.986788 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.986974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.987129 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.987129 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.987421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.987421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.987711 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.987711 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.988016 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.988167 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.988326 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-9-iscsi {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.988482 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.988633 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.988778 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.988926 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.989079 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.989230 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.989384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.989529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.989682 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.989846 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.990005 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.990193 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.990354 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.990498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.990651 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.990808 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.990986 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.991142 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.991294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.991437 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.991596 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.991758 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.991910 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.992068 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.992211 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.992361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.992513 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.992665 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.992818 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.992962 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.993118 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.993269 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.993418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.993418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.993712 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.993864 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.994038 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.994201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.994346 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-9-iscsi {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.994497 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.994642 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.994800 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.994946 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.995088 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.995240 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.995391 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.995554 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.996211 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.996392 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.996680 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.997017 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.997178 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.997403 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.997559 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.997703 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.997855 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.998032 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.998201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.998201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.998504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.998656 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.998857 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.999022 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.999169 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.999327 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.999471 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.999622 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.999766 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:15.999909 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.000065 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.000328 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.001014 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.001212 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.001368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.001521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.001685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.001847 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.001996 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.001996 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.002337 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.002481 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.002638 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.002790 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.002945 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.003109 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.003260 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.003404 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.003569 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.003768 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.003914 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.004064 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.004216 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.004374 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.004527 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.005274 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.005456 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.005603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.005756 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.006447 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.006628 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.006847 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.007259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.007424 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.007585 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.007738 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.007889 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.008033 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.008198 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.008343 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.008499 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.009481 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.009659 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.009816 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.009963 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.010138 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.010866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.011026 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.011190 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.011335 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.011489 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.011633 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.011789 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.011942 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.012337 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.012485 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.012788 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.013015 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.013165 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.013316 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.013472 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.013627 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.013793 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.013947 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.014131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.014292 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.014445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.014597 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.014739 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.014897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.015040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.015197 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.015342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.015492 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.015647 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.015851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.016580 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.016938 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.017121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.018071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.018071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.018394 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.018551 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.018706 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.018851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.018995 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.019138 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.019290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.019445 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.019597 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.019743 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.019894 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.020038 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.020183 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.020334 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.020477 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.020627 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.020778 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.020922 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.021076 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.021234 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.021388 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.021540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.021695 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.021839 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.022270 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.022442 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.022595 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.022747 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.022899 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.023043 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.023203 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.023357 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.023760 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.023910 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.024061 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.024212 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.024371 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.024515 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.024650 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.024954 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.025107 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.025251 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.025411 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.025584 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.025676 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.025824 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.026079 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.026428 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.026741 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.026852 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.026967 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.027104 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.027194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.027289 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.027376 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.027460 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.027544 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.027627 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.027725 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.027812 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.027923 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.028188 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.028295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.028397 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.028580 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.028677 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.028763 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.028854 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.028946 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.029038 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.029132 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.029225 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.029318 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.029411 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.029506 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.029599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.029694 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.029769 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.029848 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.029921 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.031033 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.031146 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.031242 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.031336 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.031410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.032032 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.032136 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.032257 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.032355 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.032441 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.032533 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.032619 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.032716 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.032811 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.032904 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.032990 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.033073 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.033164 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.033256 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.033354 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:55:16.033447 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.033532 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.033616 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.033782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.033882 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.033976 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.034092 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.034179 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.034270 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.034362 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.034467 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.034555 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.034646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.034743 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.034828 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.034990 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.035089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.035182 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.035267 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.035358 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.035444 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.035540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.035626 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.035757 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.035846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.035938 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.036031 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.036132 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.036245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.036401 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.036506 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.036506 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.036910 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.037024 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.037120 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.037216 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.037310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.037397 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.037481 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.037574 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.037658 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.037750 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.037842 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.037927 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.038091 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.038195 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.038297 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.038392 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.038477 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.038566 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.038665 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.038758 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.038850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.038943 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.039027 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.039111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.039202 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.039288 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.039378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.039469 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.039561 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.039646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.039741 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.039826 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.039916 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.040007 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.040098 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.040192 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.040284 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.040378 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.040470 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.040561 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.040646 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.040742 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.040833 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.040918 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.041008 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.041100 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.041185 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.041281 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.041369 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.041453 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.041536 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.041620 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.041709 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.041806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.041898 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.041989 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.042103 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.042190 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.042273 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.042365 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.042458 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.042542 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.042625 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.042708 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.042804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.042897 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.042981 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.043064 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.043147 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.043238 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.043336 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.043422 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.043505 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.043596 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.043681 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.043771 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.043866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.043950 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.044035 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.044126 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.044218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.044316 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.044410 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.044501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.044590 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.044664 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.044741 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.044822 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.044902 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.044975 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.045053 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.045126 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.045196 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.045280 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.045353 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.045424 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.045502 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.045585 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.045668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.045760 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.045845 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.045937 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.046258 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.046360 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.046454 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.046555 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.046641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.046725 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.046831 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.047800 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.047940 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.048051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.048138 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.048223 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.048317 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.048412 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.048568 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.048663 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.048787 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.048879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.048959 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.049043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.049140 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.049227 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.050447 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.050543 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.050618 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.050705 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.050789 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.050870 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.050943 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.051015 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.051085 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.051165 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.051246 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.051331 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.051412 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.051491 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.051564 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.051644 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.051723 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.051813 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.051891 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.051970 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.052043 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.052126 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.052199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.052280 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.052910 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.053021 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.053097 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.053179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.053260 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.053333 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.053463 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.053783 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.054139 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.054234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.054455 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.054738 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.054835 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.054933 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.055093 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.055279 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.055411 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.055619 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.055724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.055976 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.056094 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.056332 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.056468 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.056680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.056790 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.056995 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.057145 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.057353 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.057467 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.057699 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.057793 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.058046 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.058163 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.058385 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.058486 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.058709 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.058958 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.059063 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.059291 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.059383 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.059614 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.059712 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.059935 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.060036 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.060253 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.060350 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.060578 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.060668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.060904 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.061171 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.061264 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.061515 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.061607 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.061840 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.061939 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.062198 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.062327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.062529 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.062665 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.062879 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.063017 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.063207 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.063338 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.063557 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.063697 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.063902 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.064049 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.064213 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.064354 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.064547 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.064685 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.064862 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.064993 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.065173 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.065308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.065489 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.065629 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.065801 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.065941 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.066137 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.066283 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.066458 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.066600 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.066772 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.066902 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.067168 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.067311 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.067468 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.067603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.067731 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.067867 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.068004 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.068129 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.068309 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.068453 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.068620 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.068776 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.068960 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.069111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.069284 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.069418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.069623 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.069751 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.069967 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.070123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.070313 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.070440 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.070626 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.070756 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.070938 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.071081 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.071261 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.071402 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.071581 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.071713 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.071889 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.072019 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.072203 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.072336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.072522 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.072656 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.072844 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.072977 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.073161 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.073299 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.073479 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.073618 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.073789 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.073928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.074126 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.074260 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.074438 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.074566 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.074754 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.074882 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.075067 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.075200 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.075375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.075522 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.075692 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.075822 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.076002 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.076133 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.076322 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.076464 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.076638 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.076780 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.076947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.077087 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.077261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.077401 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.077571 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.077701 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.077887 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.078045 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.078228 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.078394 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.078565 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.078739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.078880 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.079024 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.079230 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.079360 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.079488 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.079614 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.079790 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.079932 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.080104 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.080237 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.080409 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.080542 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.080727 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.080860 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.081035 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.081177 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.081341 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.081475 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.081650 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.081782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.081961 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.082244 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.082383 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.082510 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.082638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.082779 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.082931 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.083064 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.083245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.083376 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.083556 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.083702 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.083865 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.083998 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.084178 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.084311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.084488 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.084633 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.084796 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.084937 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.085111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.085245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.085426 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.085565 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.085739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.085871 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.086064 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.086210 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.086415 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.086546 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.086681 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.086970 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.087108 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.087275 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.087411 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.087586 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.087712 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.087894 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.088034 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.088203 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.088338 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.088512 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.088645 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.088818 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.088951 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.089127 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.089270 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.089454 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.089594 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.089766 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.089912 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.090110 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.090253 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.090384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.090513 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.090685 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.090819 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.091031 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.091171 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.091341 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.091483 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.091661 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.091799 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.091975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.092116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.092293 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.092434 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.092606 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.092739 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.092916 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.093053 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.093226 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.093368 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.093538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.093676 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.093845 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.094513 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.094710 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.095035 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.095300 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.095432 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.095629 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.095762 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.095953 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.096101 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.096265 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.096411 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.096574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.096705 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.096887 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.097029 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.097207 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.097338 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.097522 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.097648 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.097846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.097987 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.098201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.098332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.098522 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.098654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.098833 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.098968 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.099147 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.099274 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.099460 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.099594 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.099770 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.099897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.100080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.100210 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.100388 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.100526 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.100701 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.100835 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.101013 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.101156 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.101321 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.101460 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.101631 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.101761 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.101942 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.102092 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.102293 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.102439 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.102607 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.102747 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.102918 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.103056 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.103221 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.103366 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.103540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.103678 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.103848 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.103980 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.104155 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.104300 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.104462 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.104596 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.104769 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.104902 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.105081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.105222 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.105389 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.105528 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.105705 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.105835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.106056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.106193 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.106361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.106493 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.106687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.106818 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.107002 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.107136 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.107315 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.107449 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.107630 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.107754 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.107949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.108081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.108265 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.108403 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.108575 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.108715 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.108910 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.109047 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.109233 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.109365 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.109549 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.109739 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.110446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.110589 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.110754 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.110886 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.111065 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.111205 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.111379 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.111519 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.111684 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.111815 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.111991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.112130 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.112297 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.112431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.112620 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.112753 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.112928 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.113062 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.113240 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.113379 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.113557 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.113697 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.113874 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.114057 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.114201 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.114337 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.114519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.114675 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.114818 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.114990 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.115121 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.115301 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.115434 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.115624 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.115838 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.115976 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.116111 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.116261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.116401 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.116568 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.116702 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.116919 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.117063 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.117231 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.117372 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.117556 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.117698 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.117882 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.118039 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.118220 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.118355 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.118538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.118664 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.118844 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.118976 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.119170 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.119303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.119496 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.119622 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.119814 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.119954 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.120137 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.120284 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.120446 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.120576 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.120769 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.120910 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.121089 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.121227 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.121411 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.121529 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.121725 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.121887 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.122059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.122198 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.122395 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.122528 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.122705 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.122844 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.123013 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.123156 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.123322 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.123463 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.123648 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.123782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.123959 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.124085 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.124271 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.124397 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.124584 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.124685 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.124908 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.125007 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.125202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.125314 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.125538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.125631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.125852 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.125958 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.126184 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.126277 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.126511 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.126610 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.126831 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.126922 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.127145 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.127243 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.127463 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.127610 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.127768 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.127899 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.128081 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.128213 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.128389 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.128529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.128696 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.128837 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.129003 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.129153 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.129304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.129435 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.129623 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.129746 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.129930 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.130111 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.130251 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.130379 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.130570 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.130713 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.130885 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.131031 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.131207 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.131347 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.131544 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.131685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.131874 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.132017 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.132191 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.132332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.132510 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.132642 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.132835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.132968 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.133139 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.133280 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.133442 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.133575 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.133754 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.133887 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.134081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.134216 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.134388 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.134530 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.134693 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.134827 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.135029 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.135162 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.135335 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.135476 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.135639 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.135773 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.135943 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.136085 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.136267 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.136400 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.136573 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.136714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.136901 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.137033 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.137213 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.137426 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.137565 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.137695 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.137829 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.137948 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.138112 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.138256 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.138456 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.138590 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.138765 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.138890 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.139098 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.139239 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.139420 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.139599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.139732 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.139921 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.140061 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.140241 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.140373 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.140571 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.140705 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.140927 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.141077 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.141262 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.141395 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.141578 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.141711 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.141900 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.142061 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.142240 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.142379 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.142560 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.142701 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.142878 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.143025 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.143189 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.143331 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.143507 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.143641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.143815 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.143960 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.144143 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.144268 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.144477 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.144704 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.144849 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.145040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.145181 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.145359 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.145530 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.145670 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.145865 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.146026 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.146212 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.146345 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.146545 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.146690 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.146883 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.147270 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.147451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.147583 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.147767 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.147913 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.148078 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.148202 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.148387 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.148518 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.148701 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.148847 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.149034 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.149167 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.149350 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.149483 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.149672 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.149814 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.149993 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.150161 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.150333 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.150465 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.150646 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.150787 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.150962 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.151108 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.151293 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.151426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.151610 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.151751 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.151942 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.152081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.152267 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.152400 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.152581 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.152713 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.152897 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.153030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.153210 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.153358 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.153527 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.153660 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.153843 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.153973 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.154177 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.154330 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.154488 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.154619 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.154802 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.154933 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.155115 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.155261 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.155443 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.155577 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.155773 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.155911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.156091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.156224 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.156456 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.157119 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.157250 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.157387 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.157573 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.157708 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.157928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.158099 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.158283 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.158427 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.158611 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.158747 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.158947 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.159072 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.159262 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.159394 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.159576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.159709 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.159893 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.160025 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.160207 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.160348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.160521 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.160663 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.160835 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.160975 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.161152 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.161299 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.161463 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.161597 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.161778 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.161910 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.162123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.162274 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.162437 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.162571 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.162746 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.162880 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.163069 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.163212 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.163381 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.163514 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.163691 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.163921 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.164068 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.164275 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.164408 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.164594 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.164734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.164923 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.165070 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.165253 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.165386 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.165574 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.165716 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.165885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.166083 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.166240 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.166385 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.166551 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.166685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.166859 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.167008 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.167179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.167321 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.167500 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.167638 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.167853 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.167974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.168120 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.168257 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.168407 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.168617 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.168752 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.168891 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.169029 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.169159 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.169295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.169425 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.169563 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.169694 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.169880 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.170041 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.170211 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.170345 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.170521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.170828 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.170961 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.171140 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.171281 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.171447 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.171589 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.171754 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.171887 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.172061 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.172934 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.173135 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.173308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.173468 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.173633 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.173796 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.173950 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.174171 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.174330 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.174485 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.174646 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.174800 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.174970 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.175134 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.175303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.175456 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.175617 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.175769 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.175936 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.176097 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.176265 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.176426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.176580 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.176739 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.176908 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.177069 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.177228 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.177383 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.177543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.177703 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.177865 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.178061 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.178282 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.178456 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.178671 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.178971 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.179139 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.179324 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.179506 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.179660 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.179820 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.179981 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.180133 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.180295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.180478 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.180663 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.180827 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.180827 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.181135 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.181135 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.181439 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.181605 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.181768 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.181920 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.182101 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.182256 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.182410 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.182573 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.182739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.182896 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.183048 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.183201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.183354 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.183512 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.183676 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.183828 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.183987 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.184139 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.184292 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.184453 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.184453 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.184750 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.184902 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.185069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.185220 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.185383 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.185553 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.185714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.185875 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.186056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.186214 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.186387 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.186541 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.186704 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.186868 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.187032 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.187195 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.187349 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.187507 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.187662 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.187880 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.188039 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.188230 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.188419 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.188623 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.188819 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.189046 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.189237 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.189433 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.189618 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.189783 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.189954 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.190181 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.190335 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.190501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.190687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.190866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.190866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.191182 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.191347 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.191507 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.191666 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.191819 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.191982 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.192136 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.192303 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.192469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.192632 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.192783 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.192939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.193093 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.193255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.193409 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.193559 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.193720 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.193880 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.194089 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.194250 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.194412 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.194574 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.194737 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.194898 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.195062 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.195225 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.195385 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.195550 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.195711 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.195863 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.196032 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.196186 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.196348 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.196527 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.196724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.196911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.197108 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.197296 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.197473 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.197638 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.197799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.197967 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.198164 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.198352 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.198540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.198725 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.198926 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.199225 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.199438 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.199636 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.199811 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.199964 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.200117 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.200279 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.200433 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.200584 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.200752 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.200946 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.201110 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.201277 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.201439 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.201592 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.201752 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.201903 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.202106 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.202263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.202263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.202562 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.202713 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.202877 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.203042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.203194 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.203344 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.203504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.203656 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.203806 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.203966 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.204119 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.204270 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.204420 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.204572 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.204731 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.204897 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.205049 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.205207 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.205366 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.205516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.205679 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.205830 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.205981 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.206172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.206324 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.206476 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.206476 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.206796 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.206950 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.207111 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.207262 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.207421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.207581 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.207761 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.207915 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.208068 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.208227 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.208387 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.208578 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.208742 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.208917 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.209120 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.209305 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.209520 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.209708 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.209903 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.210087 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.210246 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.210410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.210578 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.210739 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.210907 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.211099 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.211260 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.211428 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.211595 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.211749 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.211902 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.212063 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.212216 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.212382 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.212535 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.212694 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.212847 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.213024 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.213208 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.213376 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.213537 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.213689 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.213857 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.214031 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.214232 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.214412 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.214568 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.214719 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.214871 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.215031 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.215201 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.215355 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.215506 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.215657 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.215816 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.215967 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.216129 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.216296 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.216456 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.216607 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.216760 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.216911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.217139 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.217301 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.217463 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.217616 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.217775 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.217943 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.218157 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.218314 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.218467 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.218638 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.218807 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.218974 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.219660 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.219847 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.219847 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 14:55:16.220210 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.220210 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.220210 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.220210 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.220210 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.220210 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.220210 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.220210 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.221430 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.221430 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.221430 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.221430 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.221430 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.221430 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.221430 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.222483 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.222483 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.222483 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.222917 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.222917 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.223224 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.223524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.223840 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.224152 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.224473 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.224789 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.225098 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.225414 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.225720 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.226066 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.226365 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.226684 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.226998 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.227311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.227624 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.227936 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.228248 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.228559 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.228901 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.229241 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.229563 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.229919 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.230250 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.230580 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.230898 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.231227 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.231557 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.231885 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.232207 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.232543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.232864 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.233184 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.233505 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.234041 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.234208 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.234459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.235388 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.235727 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.236044 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.236378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.236716 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.237048 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.237381 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.237705 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.238076 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.238397 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.238716 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.239042 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.239360 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.239679 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.240011 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.240325 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.240643 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.240980 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.241299 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.241635 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.241973 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.242360 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.242682 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.243037 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.243376 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.243702 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.244022 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.244337 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:55:16.244589 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 14:55:16.276941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO dbcounter [None req-8ca49052-ae9f-46d0-9de3-69674bec0d65 None None] Registered counter for database nova_api May 25 14:55:16.298259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_db.sqlalchemy.engines [None req-8ca49052-ae9f-46d0-9de3-69674bec0d65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:55:16.305682 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writer thread running {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:55:16.306192 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO dbcounter [None req-79d89ca1-72f2-4694-b533-12022841f9c2 None None] Registered counter for database nova_api May 25 14:55:16.325990 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_db.sqlalchemy.engines [None req-79d89ca1-72f2-4694-b533-12022841f9c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:55:16.333524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writer thread running {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:55:16.363935 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.context [None req-8ca49052-ae9f-46d0-9de3-69674bec0d65 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f226ac9f-7602-4f04-9db9-a539f668d3bc(cell1) {{(pid=124524) load_cells /opt/stack/nova/nova/context.py:464}} May 25 14:55:16.368091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8ca49052-ae9f-46d0-9de3-69674bec0d65 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:16.369650 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8ca49052-ae9f-46d0-9de3-69674bec0d65 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:16.370475 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8ca49052-ae9f-46d0-9de3-69674bec0d65 None None] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:16.372462 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8ca49052-ae9f-46d0-9de3-69674bec0d65 None None] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:16.374451 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO dbcounter [None req-8ca49052-ae9f-46d0-9de3-69674bec0d65 None None] Registered counter for database nova_cell0 May 25 14:55:16.378512 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO dbcounter [None req-8ca49052-ae9f-46d0-9de3-69674bec0d65 None None] Registered counter for database nova_cell1 May 25 14:55:16.385690 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_db.sqlalchemy.engines [None req-8ca49052-ae9f-46d0-9de3-69674bec0d65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:55:16.387924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_db.sqlalchemy.engines [None req-8ca49052-ae9f-46d0-9de3-69674bec0d65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:55:16.392687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.context [None req-79d89ca1-72f2-4694-b533-12022841f9c2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f226ac9f-7602-4f04-9db9-a539f668d3bc(cell1) {{(pid=124523) load_cells /opt/stack/nova/nova/context.py:464}} May 25 14:55:16.393498 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writer thread running {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:55:16.396884 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-79d89ca1-72f2-4694-b533-12022841f9c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:16.398769 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-79d89ca1-72f2-4694-b533-12022841f9c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:16.398993 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writer thread running {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:55:16.399581 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-79d89ca1-72f2-4694-b533-12022841f9c2 None None] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:16.401606 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-79d89ca1-72f2-4694-b533-12022841f9c2 None None] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:16.403629 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO dbcounter [None req-79d89ca1-72f2-4694-b533-12022841f9c2 None None] Registered counter for database nova_cell0 May 25 14:55:16.408307 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO dbcounter [None req-79d89ca1-72f2-4694-b533-12022841f9c2 None None] Registered counter for database nova_cell1 May 25 14:55:16.415888 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_db.sqlalchemy.engines [None req-79d89ca1-72f2-4694-b533-12022841f9c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:55:16.417288 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_db.sqlalchemy.engines [None req-79d89ca1-72f2-4694-b533-12022841f9c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:55:16.424264 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writer thread running {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:55:16.425571 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writer thread running {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:55:16.546604 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO dbcounter [None req-8ca49052-ae9f-46d0-9de3-69674bec0d65 None None] Registered counter for database nova_cell0 May 25 14:55:16.556636 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_db.sqlalchemy.engines [None req-8ca49052-ae9f-46d0-9de3-69674bec0d65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:55:16.561240 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writer thread running {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:55:16.576465 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO dbcounter [None req-79d89ca1-72f2-4694-b533-12022841f9c2 None None] Registered counter for database nova_cell0 May 25 14:55:16.583343 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_db.sqlalchemy.engines [None req-79d89ca1-72f2-4694-b533-12022841f9c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:55:16.589446 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writer thread running {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:55:16.896492 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: WARNING keystonemiddleware.auth_token [None req-8ca49052-ae9f-46d0-9de3-69674bec0d65 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 14:55:16.905566 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: WARNING keystonemiddleware.auth_token [None req-8ca49052-ae9f-46d0-9de3-69674bec0d65 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 14:55:16.916205 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: WARNING keystonemiddleware.auth_token [None req-79d89ca1-72f2-4694-b533-12022841f9c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 14:55:16.924648 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: WARNING keystonemiddleware.auth_token [None req-79d89ca1-72f2-4694-b533-12022841f9c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 14:55:17.262385 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: WARNING keystonemiddleware.auth_token [None req-8ca49052-ae9f-46d0-9de3-69674bec0d65 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 14:55:17.268985 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: WARNING keystonemiddleware.auth_token [None req-8ca49052-ae9f-46d0-9de3-69674bec0d65 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 14:55:17.270833 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: WARNING keystonemiddleware.auth_token [None req-79d89ca1-72f2-4694-b533-12022841f9c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 14:55:17.274659 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5589058f99c0 pid: 124524 (default app) May 25 14:55:17.277649 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: WARNING keystonemiddleware.auth_token [None req-79d89ca1-72f2-4694-b533-12022841f9c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 14:55:17.283690 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5589058f99c0 pid: 124523 (default app) May 25 14:55:59.637351 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=3 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:59.638634 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=3 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:59.640261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=3 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:59.640989 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=3 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:01.071963 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-e778b5c7-2b57-47fe-8a4e-abd75f38f63c tempest-VolumesGetTestJSON-1827909837 tempest-VolumesGetTestJSON-1827909837-project] Action: 'create', calling method: .version_select at 0x7fb1e0f36c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1276000953", "metadata": {"Type": "work"}}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:02.451302 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-e778b5c7-2b57-47fe-8a4e-abd75f38f63c tempest-VolumesGetTestJSON-1827909837 tempest-VolumesGetTestJSON-1827909837-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.819731 May 25 14:56:02.453057 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 1/1] 10.222.0.78 () {60 vars in 1155 bytes} [Wed May 25 14:55:59 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2823 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 25 14:56:02.464929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-fd50b619-5fdf-4195-a77a-b80ad2f33120 tempest-VolumesGetTestJSON-1827909837 tempest-VolumesGetTestJSON-1827909837-project] Calling method '.version_select at 0x7fb1e0d84b80>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:02.516181 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-5cf2d2c4-194e-4f4a-bc56-1dcc60d9b7cb tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] Calling method '.version_select at 0x7fb1e0ef9670>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:02.577572 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-fd50b619-5fdf-4195-a77a-b80ad2f33120 tempest-VolumesGetTestJSON-1827909837 tempest-VolumesGetTestJSON-1827909837-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/c2c23b8f-e51e-4f25-9a17-91ebd0863ea9" status: 200 len: 353 microversion: 2.1 time: 0.116817 May 25 14:56:02.578163 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 2/2] 10.222.0.78 () {58 vars in 1244 bytes} [Wed May 25 14:56:02 2022] GET /compute/v2.1/os-volumes/c2c23b8f-e51e-4f25-9a17-91ebd0863ea9 => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:56:02.587297 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=3 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:02.588918 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=3 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:02.590140 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=3 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:02.592596 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=3 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:02.936654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-5cf2d2c4-194e-4f4a-bc56-1dcc60d9b7cb tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/1bf1147a-8d6c-4b3e-b792-7834555b622d" status: 200 len: 350 microversion: 2.1 time: 0.994889 May 25 14:56:02.944457 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 1/3] 10.222.0.78 () {58 vars in 1244 bytes} [Wed May 25 14:56:01 2022] GET /compute/v2.1/os-volumes/1bf1147a-8d6c-4b3e-b792-7834555b622d => generated 350 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:03.589592 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-501347dd-e39e-4e5a-8e2d-9b3a8497646f tempest-VolumesGetTestJSON-1827909837 tempest-VolumesGetTestJSON-1827909837-project] Calling method '.version_select at 0x7fb1e0d84dc0>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:03.691890 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-501347dd-e39e-4e5a-8e2d-9b3a8497646f tempest-VolumesGetTestJSON-1827909837 tempest-VolumesGetTestJSON-1827909837-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/c2c23b8f-e51e-4f25-9a17-91ebd0863ea9" status: 200 len: 354 microversion: 2.1 time: 0.106321 May 25 14:56:03.698729 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 3/4] 10.222.0.78 () {58 vars in 1244 bytes} [Wed May 25 14:56:03 2022] GET /compute/v2.1/os-volumes/c2c23b8f-e51e-4f25-9a17-91ebd0863ea9 => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:03.706664 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-6e629b60-663d-4d38-8b30-dd2df330b39f tempest-VolumesGetTestJSON-1827909837 tempest-VolumesGetTestJSON-1827909837-project] Calling method '.version_select at 0x7fb1e0dbfc10>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:03.821123 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-6e629b60-663d-4d38-8b30-dd2df330b39f tempest-VolumesGetTestJSON-1827909837 tempest-VolumesGetTestJSON-1827909837-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/c2c23b8f-e51e-4f25-9a17-91ebd0863ea9" status: 200 len: 354 microversion: 2.1 time: 0.120598 May 25 14:56:03.821985 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 2/5] 10.222.0.78 () {58 vars in 1244 bytes} [Wed May 25 14:56:03 2022] GET /compute/v2.1/os-volumes/c2c23b8f-e51e-4f25-9a17-91ebd0863ea9 => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:03.843600 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-afae8ac8-ef5f-4a3d-ab8a-f066cc54c240 tempest-VolumesGetTestJSON-1827909837 tempest-VolumesGetTestJSON-1827909837-project] Calling method '.version_select at 0x7fb1e0d9d310>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:03.926365 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-afae8ac8-ef5f-4a3d-ab8a-f066cc54c240 tempest-VolumesGetTestJSON-1827909837 tempest-VolumesGetTestJSON-1827909837-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/c2c23b8f-e51e-4f25-9a17-91ebd0863ea9" status: 202 len: 0 microversion: 2.1 time: 0.086548 May 25 14:56:03.932574 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 4/6] 10.222.0.78 () {58 vars in 1247 bytes} [Wed May 25 14:56:03 2022] DELETE /compute/v2.1/os-volumes/c2c23b8f-e51e-4f25-9a17-91ebd0863ea9 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 14:56:03.936968 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-140b3dab-32d8-4995-91e6-64628cc63c1b tempest-VolumesGetTestJSON-1827909837 tempest-VolumesGetTestJSON-1827909837-project] Calling method '.version_select at 0x7fb1e0dbfb80>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:04.002644 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-140b3dab-32d8-4995-91e6-64628cc63c1b tempest-VolumesGetTestJSON-1827909837 tempest-VolumesGetTestJSON-1827909837-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/c2c23b8f-e51e-4f25-9a17-91ebd0863ea9" status: 200 len: 353 microversion: 2.1 time: 0.071265 May 25 14:56:04.003539 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 3/7] 10.222.0.78 () {58 vars in 1244 bytes} [Wed May 25 14:56:03 2022] GET /compute/v2.1/os-volumes/c2c23b8f-e51e-4f25-9a17-91ebd0863ea9 => generated 353 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:04.708487 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-f0aa86aa-1119-4d9c-9471-143ad324d460 tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] Calling method '.version_select at 0x7fb1e0d9d9d0>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:04.870227 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-f0aa86aa-1119-4d9c-9471-143ad324d460 tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/4bd77702-5951-4663-8015-7b1672930288" status: 200 len: 351 microversion: 2.1 time: 0.165447 May 25 14:56:04.871089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 5/8] 10.222.0.78 () {58 vars in 1244 bytes} [Wed May 25 14:56:04 2022] GET /compute/v2.1/os-volumes/4bd77702-5951-4663-8015-7b1672930288 => generated 351 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:05.016380 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-51fad966-a2c1-4c3e-a72e-7ecfb06c0d59 tempest-VolumesGetTestJSON-1827909837 tempest-VolumesGetTestJSON-1827909837-project] Calling method '.version_select at 0x7fb1e0d854c0>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:05.088161 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-51fad966-a2c1-4c3e-a72e-7ecfb06c0d59 tempest-VolumesGetTestJSON-1827909837 tempest-VolumesGetTestJSON-1827909837-project] HTTP exception thrown: Volume c2c23b8f-e51e-4f25-9a17-91ebd0863ea9 could not be found. May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-51fad966-a2c1-4c3e-a72e-7ecfb06c0d59 tempest-VolumesGetTestJSON-1827909837 tempest-VolumesGetTestJSON-1827909837-project] Request method failure captured: May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/os-volumes/c2c23b8f-e51e-4f25-9a17-91ebd0863ea9 HTTP/1.1 May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkN_C067Jmx4Xs-0X8_TtiYMCTJz_wgAT9htUSkvh_qOfF4HEdYynivqV81UuypkUSvH4EJvKsTrSmmjGB_fPeXL-sArfqoELU1vIbLsxpQeKrtEQO6EpQGfjqdOONM360rTPCErdAG9__ZpjjfKx1mxe2PE1hULIxqKgS38ayZtXrQ May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 0eb91a551f3a47d3aac0d8003eeac7e8 May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-VolumesGetTestJSON-1827909837 May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 14:56:05.094700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 14:56:05.095752 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0eb91a551f3a47d3aac0d8003eeac7e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0eb91a551f3a47d3aac0d8003eeac7e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0eb91a551f3a47d3aac0d8003eeac7e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0eb91a551f3a47d3aac0d8003eeac7e8"}]}] May 25 14:56:05.095752 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-VolumesGetTestJSON-1827909837 May 25 14:56:05.095752 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 0eb91a551f3a47d3aac0d8003eeac7e8 May 25 14:56:05.095752 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-VolumesGetTestJSON-1827909837 May 25 14:56:05.095752 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-VolumesGetTestJSON-1827909837-project May 25 14:56:05.095752 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 14:56:05.095752 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 14:56:05.095752 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: 03ddd6d7c04a4f96a2165944fab4aabf May 25 14:56:05.095752 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-VolumesGetTestJSON-1827909837-project May 25 14:56:05.095752 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: May 25 14:56:05.095752 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Volume c2c23b8f-e51e-4f25-9a17-91ebd0863ea9 could not be found. May 25 14:56:05.095752 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': 'c2c23b8f-e51e-4f25-9a17-91ebd0863ea9'} May 25 14:56:05.095752 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c2c23b8f-e51e-4f25-9a17-91ebd0863ea9 could not be found. (HTTP 404) (Request-ID: req-c3e7e048-e955-4f99-bc72-7c307306844b) May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:05.096754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 14:56:05.097668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c2c23b8f-e51e-4f25-9a17-91ebd0863ea9 could not be found. May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 14:56:05.098543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:56:05.099440 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c2c23b8f-e51e-4f25-9a17-91ebd0863ea9 could not be found. May 25 14:56:05.099440 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:56:05.099440 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:05.099440 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:56:05.099440 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:05.099440 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:05.099440 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:05.099440 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:56:05.099440 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:56:05.099440 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c2c23b8f-e51e-4f25-9a17-91ebd0863ea9 could not be found. May 25 14:56:05.099440 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:56:05.102503 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-51fad966-a2c1-4c3e-a72e-7ecfb06c0d59 tempest-VolumesGetTestJSON-1827909837 tempest-VolumesGetTestJSON-1827909837-project] Returning 404 to user: Volume c2c23b8f-e51e-4f25-9a17-91ebd0863ea9 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:56:05.103634 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-51fad966-a2c1-4c3e-a72e-7ecfb06c0d59 tempest-VolumesGetTestJSON-1827909837 tempest-VolumesGetTestJSON-1827909837-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/c2c23b8f-e51e-4f25-9a17-91ebd0863ea9" status: 404 len: 109 microversion: 2.1 time: 0.091989 May 25 14:56:05.121196 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 4/9] 10.222.0.78 () {58 vars in 1244 bytes} [Wed May 25 14:56:05 2022] GET /compute/v2.1/os-volumes/c2c23b8f-e51e-4f25-9a17-91ebd0863ea9 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 14:56:05.316127 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-9d12becc-7bed-470a-ae8c-f517f910e4aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-965333457", "imageRef": "fbec7c78-0103-4632-9a21-d8e8056f2ce0", "flavorRef": "452", "networks": [{"uuid": "e191e023-56ce-41de-ba59-dd3f0b56465f"}]}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:05.635721 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.network.neutron [None req-9d12becc-7bed-470a-ae8c-f517f910e4aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] validate_networks() for [('e191e023-56ce-41de-ba59-dd3f0b56465f', None, None, None, None, None)] {{(pid=124524) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:56:06.678561 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e434133a-25b4-4934-9be1-c108985a103b tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] Calling method '.version_select at 0x7fb1e0d71550>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:06.765816 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e434133a-25b4-4934-9be1-c108985a103b tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/1d63d9bd-63a4-4998-8608-a42bc80f7b4d" status: 200 len: 351 microversion: 2.1 time: 0.090942 May 25 14:56:06.773462 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 5/10] 10.222.0.78 () {58 vars in 1244 bytes} [Wed May 25 14:56:06 2022] GET /compute/v2.1/os-volumes/1d63d9bd-63a4-4998-8608-a42bc80f7b4d => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:06.780307 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e665b684-d1ed-4675-ae34-4d4fab7f7335 tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] Calling method '.version_select at 0x7fb1e0d71c10>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:06.941138 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e665b684-d1ed-4675-ae34-4d4fab7f7335 tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.166455 May 25 14:56:06.950179 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 6/11] 10.222.0.78 () {58 vars in 1133 bytes} [Wed May 25 14:56:06 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:06.957453 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-78ae4030-a2b0-4d47-b8ab-97990500b75a tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] Calling method '.version_select at 0x7fb1e0d71f70>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:07.110899 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-78ae4030-a2b0-4d47-b8ab-97990500b75a tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.159512 May 25 14:56:07.111975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 7/12] 10.222.0.78 () {58 vars in 1148 bytes} [Wed May 25 14:56:06 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:07.129476 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-c0fdae72-7154-4ec3-a5fa-65626209c3e2 tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] Calling method '.version_select at 0x7fb1e0d010d0>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:07.296389 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-c0fdae72-7154-4ec3-a5fa-65626209c3e2 tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.174357 May 25 14:56:07.304146 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 8/13] 10.222.0.78 () {58 vars in 1133 bytes} [Wed May 25 14:56:07 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:07.311834 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ebe410c3-3c90-4ce7-8612-8a802be61263 tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] Calling method '.version_select at 0x7fb1e0d01d30>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:07.599672 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ebe410c3-3c90-4ce7-8612-8a802be61263 tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.293985 May 25 14:56:07.608715 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 9/14] 10.222.0.78 () {58 vars in 1166 bytes} [Wed May 25 14:56:07 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:07.614049 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3191b3c8-b095-4c24-8f4f-747e82a8b2c2 tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] Calling method '.version_select at 0x7fb1e0d01af0>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:07.819060 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3191b3c8-b095-4c24-8f4f-747e82a8b2c2 tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.208543 May 25 14:56:07.821751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 10/15] 10.222.0.78 () {58 vars in 1169 bytes} [Wed May 25 14:56:07 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:07.835804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ce05673d-d275-43c8-9c50-43a696949bbe tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] Calling method '.version_select at 0x7fb1e0d713a0>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:07.916464 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-9d12becc-7bed-470a-ae8c-f517f910e4aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Flavor limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:56:07.917442 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-9d12becc-7bed-470a-ae8c-f517f910e4aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Image limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:56:07.920516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-9d12becc-7bed-470a-ae8c-f517f910e4aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Flavor pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:56:07.921286 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-9d12becc-7bed-470a-ae8c-f517f910e4aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Image pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:56:07.921885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-9d12becc-7bed-470a-ae8c-f517f910e4aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:56:07.979268 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9d12becc-7bed-470a-ae8c-f517f910e4aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:07.980006 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9d12becc-7bed-470a-ae8c-f517f910e4aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:07.980823 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9d12becc-7bed-470a-ae8c-f517f910e4aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:07.981255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9d12becc-7bed-470a-ae8c-f517f910e4aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:08.084672 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-9d12becc-7bed-470a-ae8c-f517f910e4aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Getting quotas for project d3fab2e6427d486bb1744239b759c415. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:56:08.095357 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ce05673d-d275-43c8-9c50-43a696949bbe tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.264076 May 25 14:56:08.097210 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 11/16] 10.222.0.78 () {58 vars in 1154 bytes} [Wed May 25 14:56:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:08.103664 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-9d12becc-7bed-470a-ae8c-f517f910e4aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Getting quotas for user b3cd4cec00fe4f0a8dafba7dc16d685e and project d3fab2e6427d486bb1744239b759c415. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:56:08.110398 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a52a9eca-7238-4ac8-8d67-155cd79b8f61 tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] Calling method '.version_select at 0x7fb1e0d71940>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:08.147414 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-9d12becc-7bed-470a-ae8c-f517f910e4aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Going to run 1 instances... {{(pid=124524) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:56:08.160285 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-9d12becc-7bed-470a-ae8c-f517f910e4aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbec7c78-0103-4632-9a21-d8e8056f2ce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:56:08.340062 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-9d12becc-7bed-470a-ae8c-f517f910e4aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.318364 May 25 14:56:08.341876 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 6/17] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 14:56:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 14:56:08.353051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-42942b49-7417-4cc8-8865-1c1c041b492a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:08.353862 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-42942b49-7417-4cc8-8865-1c1c041b492a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:08.356292 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a52a9eca-7238-4ac8-8d67-155cd79b8f61 tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.251190 May 25 14:56:08.357667 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 12/18] 10.222.0.78 () {58 vars in 1187 bytes} [Wed May 25 14:56:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:08.371363 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-641f46b2-52c5-48f5-b1cb-da39aeb4f57c tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] Calling method '.version_select at 0x7fb1e0d714c0>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:08.634405 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-641f46b2-52c5-48f5-b1cb-da39aeb4f57c tempest-VolumesTestJSON-1337774559 tempest-VolumesTestJSON-1337774559-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.268912 May 25 14:56:08.635485 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 13/19] 10.222.0.78 () {58 vars in 1154 bytes} [Wed May 25 14:56:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:08.775961 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-42942b49-7417-4cc8-8865-1c1c041b492a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:08.813506 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-42942b49-7417-4cc8-8865-1c1c041b492a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1214 microversion: 2.1 time: 0.465297 May 25 14:56:08.814131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 7/20] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:08 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1214 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:09.832206 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-97abb837-432d-4b73-8e1c-4dd34273f1cd tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:09.832944 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-97abb837-432d-4b73-8e1c-4dd34273f1cd tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:10.481082 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-97abb837-432d-4b73-8e1c-4dd34273f1cd tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:10.532849 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-97abb837-432d-4b73-8e1c-4dd34273f1cd tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1214 microversion: 2.1 time: 0.704499 May 25 14:56:10.534639 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 14/21] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:09 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1214 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:11.552647 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8b2464e5-bab3-4c24-9f33-80e82d853bea tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:11.553265 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-8b2464e5-bab3-4c24-9f33-80e82d853bea tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:11.568416 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8b2464e5-bab3-4c24-9f33-80e82d853bea tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:11.569091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8b2464e5-bab3-4c24-9f33-80e82d853bea tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:11.570250 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8b2464e5-bab3-4c24-9f33-80e82d853bea tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:11.570980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8b2464e5-bab3-4c24-9f33-80e82d853bea tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:12.164778 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-8b2464e5-bab3-4c24-9f33-80e82d853bea tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:12.199931 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-8b2464e5-bab3-4c24-9f33-80e82d853bea tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1210 microversion: 2.1 time: 0.651338 May 25 14:56:12.201200 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 8/22] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:11 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1210 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:13.001853 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2a6488c4-7893-4e68-b258-ce007200d198 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Action: 'create', calling method: .version_select at 0x7fb1e1717280>, body: {"keypair": {"name": "tempest-keypair-71989662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApcRi+5E37Zu2NGzqTi5HY7UqbXFv0Fs/+AsyHCneVULfMF6IfOX52M/+KSFDVr+MVjBW5bftWa8LhFlX46NFU3Rt8yQLULFAx2AdrmHgRne5wylX47yLwnltrleeBz6w=="}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:13.128150 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-2a6488c4-7893-4e68-b258-ce007200d198 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Getting quotas for project 2395f31fad3645c19096d648c521bf31. Resources: {'key_pairs'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:56:13.150132 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-2a6488c4-7893-4e68-b258-ce007200d198 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Getting quotas for user 7fedb9b92e9a4e3cb671f69751e426a1 and project 2395f31fad3645c19096d648c521bf31. Resources: {'key_pairs'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:56:13.219748 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-c63a8e89-91bb-486a-ab5b-8b414a8e612e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:13.220549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-c63a8e89-91bb-486a-ab5b-8b414a8e612e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:13.237186 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c63a8e89-91bb-486a-ab5b-8b414a8e612e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:13.238694 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c63a8e89-91bb-486a-ab5b-8b414a8e612e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:13.239734 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c63a8e89-91bb-486a-ab5b-8b414a8e612e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:13.240385 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c63a8e89-91bb-486a-ab5b-8b414a8e612e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:13.299125 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2a6488c4-7893-4e68-b258-ce007200d198 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.657121 May 25 14:56:13.300332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 15/23] 10.222.0.78 () {60 vars in 1158 bytes} [Wed May 25 14:56:12 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:13.516842 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-c63a8e89-91bb-486a-ab5b-8b414a8e612e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:13.527702 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-c63a8e89-91bb-486a-ab5b-8b414a8e612e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1272 microversion: 2.1 time: 0.313049 May 25 14:56:13.537981 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 9/24] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:13 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1272 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:14.554343 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-486558b1-30ed-4912-8fb3-025a2e07544b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:14.555828 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-486558b1-30ed-4912-8fb3-025a2e07544b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:14.569923 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-486558b1-30ed-4912-8fb3-025a2e07544b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:14.570627 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-486558b1-30ed-4912-8fb3-025a2e07544b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:14.571593 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-486558b1-30ed-4912-8fb3-025a2e07544b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:14.572173 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-486558b1-30ed-4912-8fb3-025a2e07544b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:15.388020 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-486558b1-30ed-4912-8fb3-025a2e07544b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:15.449523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-486558b1-30ed-4912-8fb3-025a2e07544b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1272 microversion: 2.1 time: 0.891571 May 25 14:56:15.474051 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 16/25] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:14 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1272 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:16.509303 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6b397361-858b-4d20-97d4-b6b630ac2643 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:16.510655 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6b397361-858b-4d20-97d4-b6b630ac2643 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:16.538421 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6b397361-858b-4d20-97d4-b6b630ac2643 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:16.538971 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6b397361-858b-4d20-97d4-b6b630ac2643 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:16.548654 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6b397361-858b-4d20-97d4-b6b630ac2643 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:16.554947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6b397361-858b-4d20-97d4-b6b630ac2643 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:16.808885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6b397361-858b-4d20-97d4-b6b630ac2643 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:16.818364 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6b397361-858b-4d20-97d4-b6b630ac2643 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1272 microversion: 2.1 time: 0.314183 May 25 14:56:16.818952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 10/26] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:16 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1272 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:17.630169 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-62c309bf-adcb-4310-8d96-40f03c8e0362 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1612039291", "imageRef": "fbec7c78-0103-4632-9a21-d8e8056f2ce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:17.837724 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-70f87dd6-50f3-450b-b754-d9f8939dee9f tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:17.838507 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-70f87dd6-50f3-450b-b754-d9f8939dee9f tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:17.873288 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-70f87dd6-50f3-450b-b754-d9f8939dee9f tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:17.873739 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-70f87dd6-50f3-450b-b754-d9f8939dee9f tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:17.879377 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-70f87dd6-50f3-450b-b754-d9f8939dee9f tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:17.889033 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-70f87dd6-50f3-450b-b754-d9f8939dee9f tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:18.023916 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.network.neutron [None req-62c309bf-adcb-4310-8d96-40f03c8e0362 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] validate_networks() for [('e385260d-6c1a-4502-b416-70a643ca9f7a', None, None, None, None, None)] {{(pid=124523) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:56:18.042163 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:18.713770 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-70f87dd6-50f3-450b-b754-d9f8939dee9f tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:18.751015 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-70f87dd6-50f3-450b-b754-d9f8939dee9f tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1272 microversion: 2.1 time: 0.917958 May 25 14:56:18.752528 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 11/27] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:17 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1272 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:19.774492 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-9bf030c6-7612-4d23-ae4c-927b416b6904 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:19.775592 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-9bf030c6-7612-4d23-ae4c-927b416b6904 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:19.808225 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=8 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:19.815845 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9bf030c6-7612-4d23-ae4c-927b416b6904 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:19.830340 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9bf030c6-7612-4d23-ae4c-927b416b6904 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:19.832010 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9bf030c6-7612-4d23-ae4c-927b416b6904 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:19.838806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9bf030c6-7612-4d23-ae4c-927b416b6904 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:20.369678 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-9bf030c6-7612-4d23-ae4c-927b416b6904 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:20.385101 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-9bf030c6-7612-4d23-ae4c-927b416b6904 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1272 microversion: 2.1 time: 0.616051 May 25 14:56:20.391818 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 12/28] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:19 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1272 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:21.422024 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-fbb1aada-5da7-4361-a160-73c01b7ec8c7 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:21.429546 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-fbb1aada-5da7-4361-a160-73c01b7ec8c7 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:21.497327 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fbb1aada-5da7-4361-a160-73c01b7ec8c7 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:21.508063 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fbb1aada-5da7-4361-a160-73c01b7ec8c7 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:21.522259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fbb1aada-5da7-4361-a160-73c01b7ec8c7 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:21.530633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fbb1aada-5da7-4361-a160-73c01b7ec8c7 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:21.847207 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-fbb1aada-5da7-4361-a160-73c01b7ec8c7 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:21.858119 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-fbb1aada-5da7-4361-a160-73c01b7ec8c7 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1272 microversion: 2.1 time: 0.456225 May 25 14:56:21.913238 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 13/29] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:21 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1272 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:22.902257 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-5b29d072-2ad1-4a5c-8b32-2e912e661e7a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:22.903754 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-5b29d072-2ad1-4a5c-8b32-2e912e661e7a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:22.926287 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5b29d072-2ad1-4a5c-8b32-2e912e661e7a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:22.930541 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5b29d072-2ad1-4a5c-8b32-2e912e661e7a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:22.931662 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5b29d072-2ad1-4a5c-8b32-2e912e661e7a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:22.932144 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5b29d072-2ad1-4a5c-8b32-2e912e661e7a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:23.177108 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=6 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:23.892872 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-5b29d072-2ad1-4a5c-8b32-2e912e661e7a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:23.903480 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-5b29d072-2ad1-4a5c-8b32-2e912e661e7a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1314 microversion: 2.1 time: 1.005102 May 25 14:56:23.912843 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 14/30] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:22 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1314 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:23.949373 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b9be50f3-a137-43c6-9b44-49c6d3d66524 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-94449162", "imageRef": "fbec7c78-0103-4632-9a21-d8e8056f2ce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da3cdcb2-1ede-42ee-8e56-23a36c228a18"}], "security_groups": [{"name": "tempest-securitygroup--1022215925"}], "key_name": "tempest-keypair-71989662", "user_data": "}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:24.312690 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.network.neutron [None req-b9be50f3-a137-43c6-9b44-49c6d3d66524 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] validate_networks() for [('da3cdcb2-1ede-42ee-8e56-23a36c228a18', None, None, None, None, None)] {{(pid=124524) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:56:24.698628 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-62c309bf-adcb-4310-8d96-40f03c8e0362 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Flavor limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:56:24.699172 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-62c309bf-adcb-4310-8d96-40f03c8e0362 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Image limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:56:24.700835 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-62c309bf-adcb-4310-8d96-40f03c8e0362 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Flavor pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:56:24.701505 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-62c309bf-adcb-4310-8d96-40f03c8e0362 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Image pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:56:24.702328 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-62c309bf-adcb-4310-8d96-40f03c8e0362 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:56:24.739138 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-62c309bf-adcb-4310-8d96-40f03c8e0362 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:24.739867 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-62c309bf-adcb-4310-8d96-40f03c8e0362 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:24.744594 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-62c309bf-adcb-4310-8d96-40f03c8e0362 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:24.752356 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-62c309bf-adcb-4310-8d96-40f03c8e0362 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:24.874351 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-62c309bf-adcb-4310-8d96-40f03c8e0362 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Getting quotas for project acd27057280d4bdda5b9a689a1e399ff. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:56:24.899596 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-62c309bf-adcb-4310-8d96-40f03c8e0362 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Getting quotas for user 97011bf8f6d444468fecdde7acfa1020 and project acd27057280d4bdda5b9a689a1e399ff. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:56:24.952138 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-62c309bf-adcb-4310-8d96-40f03c8e0362 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Going to run 1 instances... {{(pid=124523) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:56:24.968821 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-62c309bf-adcb-4310-8d96-40f03c8e0362 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbec7c78-0103-4632-9a21-d8e8056f2ce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:56:25.222830 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-62c309bf-adcb-4310-8d96-40f03c8e0362 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 8.606951 May 25 14:56:25.229071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 17/31] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 14:56:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 8611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 14:56:25.237612 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ccf9ffd4-0025-4854-9e2a-31e1b64cbd1c tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:25.239474 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ccf9ffd4-0025-4854-9e2a-31e1b64cbd1c tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:25.264485 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ccf9ffd4-0025-4854-9e2a-31e1b64cbd1c tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:25.267707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ccf9ffd4-0025-4854-9e2a-31e1b64cbd1c tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:25.269972 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ccf9ffd4-0025-4854-9e2a-31e1b64cbd1c tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:25.274067 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ccf9ffd4-0025-4854-9e2a-31e1b64cbd1c tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:25.865317 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-b9be50f3-a137-43c6-9b44-49c6d3d66524 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Flavor limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:56:25.866247 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-b9be50f3-a137-43c6-9b44-49c6d3d66524 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Image limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:56:25.867151 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-b9be50f3-a137-43c6-9b44-49c6d3d66524 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Flavor pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:56:25.867918 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-b9be50f3-a137-43c6-9b44-49c6d3d66524 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Image pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:56:25.868695 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-b9be50f3-a137-43c6-9b44-49c6d3d66524 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:56:25.921447 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b9be50f3-a137-43c6-9b44-49c6d3d66524 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:25.924992 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b9be50f3-a137-43c6-9b44-49c6d3d66524 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:25.927590 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b9be50f3-a137-43c6-9b44-49c6d3d66524 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:25.933413 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b9be50f3-a137-43c6-9b44-49c6d3d66524 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:25.995095 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-b9be50f3-a137-43c6-9b44-49c6d3d66524 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Getting quotas for project 2395f31fad3645c19096d648c521bf31. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:56:26.013278 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-b9be50f3-a137-43c6-9b44-49c6d3d66524 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Getting quotas for user 7fedb9b92e9a4e3cb671f69751e426a1 and project 2395f31fad3645c19096d648c521bf31. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:56:26.050322 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b9be50f3-a137-43c6-9b44-49c6d3d66524 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Going to run 1 instances... {{(pid=124524) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:56:26.053694 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b9be50f3-a137-43c6-9b44-49c6d3d66524 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbec7c78-0103-4632-9a21-d8e8056f2ce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:56:26.234176 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b9be50f3-a137-43c6-9b44-49c6d3d66524 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.317718 May 25 14:56:26.237384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 15/32] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 14:56:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 2323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 14:56:26.254094 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d69351ca-26f0-48dc-8155-21afe3cc1686 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:26.255450 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d69351ca-26f0-48dc-8155-21afe3cc1686 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:26.479572 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d69351ca-26f0-48dc-8155-21afe3cc1686 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:26.513649 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d69351ca-26f0-48dc-8155-21afe3cc1686 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1222 microversion: 2.1 time: 0.272807 May 25 14:56:26.519606 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 16/33] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:26 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1222 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:26.533258 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2a383d3a-56ce-44f5-950b-8395d5ba9109 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:26.540281 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2a383d3a-56ce-44f5-950b-8395d5ba9109 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:26.614992 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ccf9ffd4-0025-4854-9e2a-31e1b64cbd1c tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:26.631743 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ccf9ffd4-0025-4854-9e2a-31e1b64cbd1c tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1314 microversion: 2.1 time: 1.405970 May 25 14:56:26.632351 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 18/34] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:25 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1314 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:26.689076 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-2a383d3a-56ce-44f5-950b-8395d5ba9109 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:26.724497 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2a383d3a-56ce-44f5-950b-8395d5ba9109 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1234 microversion: 2.1 time: 0.197972 May 25 14:56:26.728729 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 17/35] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:26 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1234 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:27.307749 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-774a9691-e6bd-4216-bdcb-765fe68a2269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1177636429", "imageRef": "fbec7c78-0103-4632-9a21-d8e8056f2ce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:27.503389 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.network.neutron [None req-774a9691-e6bd-4216-bdcb-765fe68a2269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] validate_networks() for [('e385260d-6c1a-4502-b416-70a643ca9f7a', None, None, None, None, None)] {{(pid=124524) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:56:27.984376 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-623eaa9e-9306-4c9e-8a10-63bb2bfa32c9 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Action: 'create', calling method: .version_select at 0x7fb1e02fe550>, body: {"keypair": {"name": "tempest-keypair-1328946574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ16SmTVBRziTGrkP2fWMWFaMsLyfW09815xKdlqyGUzPJHQP8C8wmEp6/DMFX+iiD3g1eCL/STiv6VBjzNTH4XQKeHO2tCp2Vb197RQsN1CV1kkfZR6J6HpssIZZHa+Ug=="}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:28.040910 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-623eaa9e-9306-4c9e-8a10-63bb2bfa32c9 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Getting quotas for project 9dafcd0df8524413b4fe81a0931323b1. Resources: {'key_pairs'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:56:28.064525 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-623eaa9e-9306-4c9e-8a10-63bb2bfa32c9 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Getting quotas for user e60a5e751f22450c8e366c85b37af1f6 and project 9dafcd0df8524413b4fe81a0931323b1. Resources: {'key_pairs'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:56:28.171335 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-623eaa9e-9306-4c9e-8a10-63bb2bfa32c9 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.531262 May 25 14:56:28.177272 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 19/36] 10.222.0.78 () {60 vars in 1158 bytes} [Wed May 25 14:56:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:28.203586 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b3e4b91a-8a1c-48e9-9dc5-003ed2728c67 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:28.206738 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-b3e4b91a-8a1c-48e9-9dc5-003ed2728c67 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:28.231240 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b3e4b91a-8a1c-48e9-9dc5-003ed2728c67 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:28.234983 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b3e4b91a-8a1c-48e9-9dc5-003ed2728c67 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:28.238400 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b3e4b91a-8a1c-48e9-9dc5-003ed2728c67 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:28.240782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b3e4b91a-8a1c-48e9-9dc5-003ed2728c67 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:28.848547 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-774a9691-e6bd-4216-bdcb-765fe68a2269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Flavor limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:56:28.849839 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-774a9691-e6bd-4216-bdcb-765fe68a2269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Image limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:56:28.850561 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-774a9691-e6bd-4216-bdcb-765fe68a2269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Flavor pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:56:28.851157 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-774a9691-e6bd-4216-bdcb-765fe68a2269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Image pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:56:28.851762 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-774a9691-e6bd-4216-bdcb-765fe68a2269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:56:28.878605 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-774a9691-e6bd-4216-bdcb-765fe68a2269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:28.880188 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-774a9691-e6bd-4216-bdcb-765fe68a2269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:28.882121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-774a9691-e6bd-4216-bdcb-765fe68a2269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:28.883597 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-774a9691-e6bd-4216-bdcb-765fe68a2269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:28.957545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-774a9691-e6bd-4216-bdcb-765fe68a2269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Getting quotas for project acd27057280d4bdda5b9a689a1e399ff. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:56:28.982912 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-774a9691-e6bd-4216-bdcb-765fe68a2269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Getting quotas for user 97011bf8f6d444468fecdde7acfa1020 and project acd27057280d4bdda5b9a689a1e399ff. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:56:29.014110 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-774a9691-e6bd-4216-bdcb-765fe68a2269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Going to run 1 instances... {{(pid=124524) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:56:29.016818 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-774a9691-e6bd-4216-bdcb-765fe68a2269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbec7c78-0103-4632-9a21-d8e8056f2ce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:56:29.144448 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-774a9691-e6bd-4216-bdcb-765fe68a2269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.851307 May 25 14:56:29.157023 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 18/37] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 14:56:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 14:56:29.168960 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-bcac4b1a-3a16-46a2-a3d9-ae18f85909fc tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:29.169500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-bcac4b1a-3a16-46a2-a3d9-ae18f85909fc tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:29.198336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bcac4b1a-3a16-46a2-a3d9-ae18f85909fc tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:29.199159 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bcac4b1a-3a16-46a2-a3d9-ae18f85909fc tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:29.204630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bcac4b1a-3a16-46a2-a3d9-ae18f85909fc tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:29.205963 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bcac4b1a-3a16-46a2-a3d9-ae18f85909fc tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:29.283115 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-b3e4b91a-8a1c-48e9-9dc5-003ed2728c67 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:29.319504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-b3e4b91a-8a1c-48e9-9dc5-003ed2728c67 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1314 microversion: 2.1 time: 1.140235 May 25 14:56:29.335174 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 20/38] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:28 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1314 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:29.360399 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f283a6d7-6775-4daf-b70f-80cf446fe726 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:29.361171 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f283a6d7-6775-4daf-b70f-80cf446fe726 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:29.722511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-bcac4b1a-3a16-46a2-a3d9-ae18f85909fc tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:29.762156 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f283a6d7-6775-4daf-b70f-80cf446fe726 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:29.766359 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=53 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:29.781970 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f283a6d7-6775-4daf-b70f-80cf446fe726 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1222 microversion: 2.1 time: 0.431128 May 25 14:56:29.782963 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 21/39] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:29 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1222 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:29.822005 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-bcac4b1a-3a16-46a2-a3d9-ae18f85909fc tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1230 microversion: 2.1 time: 0.620181 May 25 14:56:29.827943 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 19/40] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:29 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1230 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:30.342441 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-92ebb472-1244-4ba4-a31b-ea720cca5341 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:30.344068 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-92ebb472-1244-4ba4-a31b-ea720cca5341 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:30.382891 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-92ebb472-1244-4ba4-a31b-ea720cca5341 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:30.389460 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-92ebb472-1244-4ba4-a31b-ea720cca5341 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:30.390490 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-92ebb472-1244-4ba4-a31b-ea720cca5341 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:30.390953 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-92ebb472-1244-4ba4-a31b-ea720cca5341 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:30.812987 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-57492f83-030e-4d3a-bfea-e6fae0e0d9ad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:30.815296 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-57492f83-030e-4d3a-bfea-e6fae0e0d9ad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:30.827744 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=9 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:30.833693 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-57492f83-030e-4d3a-bfea-e6fae0e0d9ad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:30.835903 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-57492f83-030e-4d3a-bfea-e6fae0e0d9ad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:30.837743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-57492f83-030e-4d3a-bfea-e6fae0e0d9ad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:30.838661 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-57492f83-030e-4d3a-bfea-e6fae0e0d9ad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:31.207200 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-57492f83-030e-4d3a-bfea-e6fae0e0d9ad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:31.241157 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-57492f83-030e-4d3a-bfea-e6fae0e0d9ad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1226 microversion: 2.1 time: 0.435958 May 25 14:56:31.241876 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 20/41] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:30 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1226 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:31.258193 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-fb6aac1f-2339-4455-9da4-bf1b80a47420 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:31.261283 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-fb6aac1f-2339-4455-9da4-bf1b80a47420 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:31.309044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fb6aac1f-2339-4455-9da4-bf1b80a47420 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:31.310349 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fb6aac1f-2339-4455-9da4-bf1b80a47420 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:31.314456 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fb6aac1f-2339-4455-9da4-bf1b80a47420 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:31.315402 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fb6aac1f-2339-4455-9da4-bf1b80a47420 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:32.178136 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-92ebb472-1244-4ba4-a31b-ea720cca5341 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:32.194557 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-92ebb472-1244-4ba4-a31b-ea720cca5341 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1314 microversion: 2.1 time: 1.857489 May 25 14:56:32.196336 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 22/42] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:30 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1314 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:32.206198 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-fb6aac1f-2339-4455-9da4-bf1b80a47420 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:32.225648 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-fb6aac1f-2339-4455-9da4-bf1b80a47420 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1304 microversion: 2.1 time: 0.976607 May 25 14:56:32.226671 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 21/43] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:31 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1304 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:32.260713 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-ba41ce3b-d998-4e16-b801-75d8e3afc2f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:32.261411 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-ba41ce3b-d998-4e16-b801-75d8e3afc2f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:32.290452 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ba41ce3b-d998-4e16-b801-75d8e3afc2f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:32.293511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ba41ce3b-d998-4e16-b801-75d8e3afc2f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:32.296085 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ba41ce3b-d998-4e16-b801-75d8e3afc2f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:32.298446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ba41ce3b-d998-4e16-b801-75d8e3afc2f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:32.511351 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-ba41ce3b-d998-4e16-b801-75d8e3afc2f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:32.533830 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-ba41ce3b-d998-4e16-b801-75d8e3afc2f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1274 microversion: 2.1 time: 0.275610 May 25 14:56:32.538618 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-38d7714a-4a47-429e-b565-78b01e0f66d4 req-aaff685a-c6b4-4406-be83-b28ed50ff86f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f7ac9b-d086-4fd8-ad74-1389a710a8b9", "tag": "f1103ce0-8308-4eee-ba41-b299b65a288b"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:32.539131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 22/44] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:32 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1274 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:32.565469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-38d7714a-4a47-429e-b565-78b01e0f66d4 req-aaff685a-c6b4-4406-be83-b28ed50ff86f service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:32.567147 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-38d7714a-4a47-429e-b565-78b01e0f66d4 req-aaff685a-c6b4-4406-be83-b28ed50ff86f service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:32.679725 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-38d7714a-4a47-429e-b565-78b01e0f66d4 req-aaff685a-c6b4-4406-be83-b28ed50ff86f service nova] Creating event network-changed:f1103ce0-8308-4eee-ba41-b299b65a288b for instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 on hv-cinder-80382 May 25 14:56:32.680299 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-38d7714a-4a47-429e-b565-78b01e0f66d4 req-aaff685a-c6b4-4406-be83-b28ed50ff86f service nova] Acquired lock "compute-rpcapi-router" {{(pid=124523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 25 14:56:32.686875 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3c3847ab-717a-4754-9abd-559b84534e73 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:32.690425 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3c3847ab-717a-4754-9abd-559b84534e73 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:32.695044 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3c3847ab-717a-4754-9abd-559b84534e73 None None] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:32.699003 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3c3847ab-717a-4754-9abd-559b84534e73 None None] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:32.732525 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.compute.rpcapi [None req-3c3847ab-717a-4754-9abd-559b84534e73 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 25 14:56:32.737744 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3c3847ab-717a-4754-9abd-559b84534e73 None None] Releasing lock "compute-rpcapi-router" {{(pid=124523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 25 14:56:32.797311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3c3847ab-717a-4754-9abd-559b84534e73 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.598735 May 25 14:56:32.798791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 23/45] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:33.225640 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-87b635ef-d523-4c41-bf2a-44252e0166aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:33.229726 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-87b635ef-d523-4c41-bf2a-44252e0166aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:33.248213 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-7637b441-0de0-4e6d-bc8a-bd69872480a4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:33.249702 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-7637b441-0de0-4e6d-bc8a-bd69872480a4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:33.253379 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=5 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:33.262580 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-87b635ef-d523-4c41-bf2a-44252e0166aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:33.272346 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-87b635ef-d523-4c41-bf2a-44252e0166aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:33.281615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-87b635ef-d523-4c41-bf2a-44252e0166aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:33.285608 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-87b635ef-d523-4c41-bf2a-44252e0166aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:33.294111 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7637b441-0de0-4e6d-bc8a-bd69872480a4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:33.296389 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7637b441-0de0-4e6d-bc8a-bd69872480a4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:33.300642 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7637b441-0de0-4e6d-bc8a-bd69872480a4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:33.307606 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7637b441-0de0-4e6d-bc8a-bd69872480a4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:33.878922 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-7637b441-0de0-4e6d-bc8a-bd69872480a4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:33.894735 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-7637b441-0de0-4e6d-bc8a-bd69872480a4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1292 microversion: 2.1 time: 0.652358 May 25 14:56:33.898847 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 24/46] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:33 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1292 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:33.915993 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3f6a32a1-1bde-4904-9c1a-21908f86cbcd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:33.917801 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-3f6a32a1-1bde-4904-9c1a-21908f86cbcd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:33.930533 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-87b635ef-d523-4c41-bf2a-44252e0166aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:33.932403 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3f6a32a1-1bde-4904-9c1a-21908f86cbcd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:33.932878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3f6a32a1-1bde-4904-9c1a-21908f86cbcd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:33.941315 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3f6a32a1-1bde-4904-9c1a-21908f86cbcd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:33.941769 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3f6a32a1-1bde-4904-9c1a-21908f86cbcd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:33.955143 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-87b635ef-d523-4c41-bf2a-44252e0166aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1314 microversion: 2.1 time: 0.732672 May 25 14:56:33.962482 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 23/47] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:33 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1314 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:34.181925 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-3f6a32a1-1bde-4904-9c1a-21908f86cbcd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:34.197176 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3f6a32a1-1bde-4904-9c1a-21908f86cbcd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1280 microversion: 2.1 time: 0.296619 May 25 14:56:34.201789 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 25/48] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:33 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1280 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:34.914800 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-3c11da43-aee9-43d0-b6db-f609620ac73e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:34.916015 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-3c11da43-aee9-43d0-b6db-f609620ac73e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:34.932141 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3c11da43-aee9-43d0-b6db-f609620ac73e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:34.935780 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3c11da43-aee9-43d0-b6db-f609620ac73e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:34.937830 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3c11da43-aee9-43d0-b6db-f609620ac73e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:34.940031 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3c11da43-aee9-43d0-b6db-f609620ac73e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:34.977877 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ed89b6f9-1a75-437c-a1a8-6afc380bf339 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:34.979485 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ed89b6f9-1a75-437c-a1a8-6afc380bf339 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:35.003651 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ed89b6f9-1a75-437c-a1a8-6afc380bf339 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:35.005036 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ed89b6f9-1a75-437c-a1a8-6afc380bf339 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:35.007014 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ed89b6f9-1a75-437c-a1a8-6afc380bf339 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:35.013779 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ed89b6f9-1a75-437c-a1a8-6afc380bf339 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:35.126600 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3c11da43-aee9-43d0-b6db-f609620ac73e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:35.136803 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-3c11da43-aee9-43d0-b6db-f609620ac73e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1292 microversion: 2.1 time: 0.227734 May 25 14:56:35.154941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 24/49] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:34 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1292 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:35.233897 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-52423401-9c43-49c0-a64d-4fd241d1d07c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:35.234728 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-52423401-9c43-49c0-a64d-4fd241d1d07c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:35.252286 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-52423401-9c43-49c0-a64d-4fd241d1d07c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:35.259289 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-52423401-9c43-49c0-a64d-4fd241d1d07c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:35.260994 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-52423401-9c43-49c0-a64d-4fd241d1d07c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:35.261745 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-52423401-9c43-49c0-a64d-4fd241d1d07c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:35.477546 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-52423401-9c43-49c0-a64d-4fd241d1d07c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:35.492524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-52423401-9c43-49c0-a64d-4fd241d1d07c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1280 microversion: 2.1 time: 0.261865 May 25 14:56:35.492524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 25/50] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:35 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1280 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:35.533419 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ed89b6f9-1a75-437c-a1a8-6afc380bf339 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:35.541715 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ed89b6f9-1a75-437c-a1a8-6afc380bf339 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1314 microversion: 2.1 time: 0.573190 May 25 14:56:35.555667 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 26/51] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:34 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:36.180157 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-24e51a9b-7038-4c2a-bdd2-852f1376b17a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:36.180937 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-24e51a9b-7038-4c2a-bdd2-852f1376b17a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:36.207078 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-24e51a9b-7038-4c2a-bdd2-852f1376b17a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:36.208510 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-24e51a9b-7038-4c2a-bdd2-852f1376b17a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:36.218889 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-24e51a9b-7038-4c2a-bdd2-852f1376b17a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:36.223453 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-24e51a9b-7038-4c2a-bdd2-852f1376b17a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:36.516814 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-5778b379-f3f3-4db5-8118-f048b2cd4c81 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:36.518389 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-5778b379-f3f3-4db5-8118-f048b2cd4c81 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:36.535609 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5778b379-f3f3-4db5-8118-f048b2cd4c81 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:36.537360 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5778b379-f3f3-4db5-8118-f048b2cd4c81 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:36.539928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5778b379-f3f3-4db5-8118-f048b2cd4c81 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:36.540599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5778b379-f3f3-4db5-8118-f048b2cd4c81 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:37.300126 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-24e51a9b-7038-4c2a-bdd2-852f1376b17a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:37.321148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-24e51a9b-7038-4c2a-bdd2-852f1376b17a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1360 microversion: 2.1 time: 1.145658 May 25 14:56:37.335743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 26/52] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:36 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1360 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:37.350695 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8dfa634b-7b1d-4e41-a5a4-28dc2c2f7915 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:37.351482 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-8dfa634b-7b1d-4e41-a5a4-28dc2c2f7915 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:37.361303 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8dfa634b-7b1d-4e41-a5a4-28dc2c2f7915 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:37.361717 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8dfa634b-7b1d-4e41-a5a4-28dc2c2f7915 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:37.363743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8dfa634b-7b1d-4e41-a5a4-28dc2c2f7915 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:37.364185 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8dfa634b-7b1d-4e41-a5a4-28dc2c2f7915 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:37.581350 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5778b379-f3f3-4db5-8118-f048b2cd4c81 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:37.593960 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-5778b379-f3f3-4db5-8118-f048b2cd4c81 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1322 microversion: 2.1 time: 1.084663 May 25 14:56:37.601691 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 27/53] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:36 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1322 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:37.614815 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0cb8b0df-5e36-4cdc-beec-9dd4cd18d6f4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1213517962", "imageRef": "fbec7c78-0103-4632-9a21-d8e8056f2ce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c4b07fe-140a-4a0b-9f8f-030d2bf81125"}], "security_groups": [{"name": "tempest-securitygroup--1056518899"}], "key_name": "tempest-keypair-1328946574", "user_data": "}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:37.820638 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-8dfa634b-7b1d-4e41-a5a4-28dc2c2f7915 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:37.840959 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-8dfa634b-7b1d-4e41-a5a4-28dc2c2f7915 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1314 microversion: 2.1 time: 0.502792 May 25 14:56:37.854063 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.network.neutron [None req-0cb8b0df-5e36-4cdc-beec-9dd4cd18d6f4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] validate_networks() for [('6c4b07fe-140a-4a0b-9f8f-030d2bf81125', None, None, None, None, None)] {{(pid=124523) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:56:37.854274 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 27/54] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:37 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:38.343865 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-e916b8c2-dafc-42af-bd0a-e4f9b7d71784 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:38.343865 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-e916b8c2-dafc-42af-bd0a-e4f9b7d71784 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:38.372367 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e916b8c2-dafc-42af-bd0a-e4f9b7d71784 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:38.379751 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e916b8c2-dafc-42af-bd0a-e4f9b7d71784 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:38.385054 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e916b8c2-dafc-42af-bd0a-e4f9b7d71784 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:38.385633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e916b8c2-dafc-42af-bd0a-e4f9b7d71784 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:38.917423 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=4 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:39.011192 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=16 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:39.107144 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-0cb8b0df-5e36-4cdc-beec-9dd4cd18d6f4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Flavor limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:56:39.108301 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-0cb8b0df-5e36-4cdc-beec-9dd4cd18d6f4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Image limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:56:39.109022 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-0cb8b0df-5e36-4cdc-beec-9dd4cd18d6f4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Flavor pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:56:39.109789 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-0cb8b0df-5e36-4cdc-beec-9dd4cd18d6f4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Image pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:56:39.110354 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-0cb8b0df-5e36-4cdc-beec-9dd4cd18d6f4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:56:39.136294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-e916b8c2-dafc-42af-bd0a-e4f9b7d71784 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:39.143754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0cb8b0df-5e36-4cdc-beec-9dd4cd18d6f4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:39.145017 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0cb8b0df-5e36-4cdc-beec-9dd4cd18d6f4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:39.149477 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0cb8b0df-5e36-4cdc-beec-9dd4cd18d6f4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:39.152303 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-e916b8c2-dafc-42af-bd0a-e4f9b7d71784 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1360 microversion: 2.1 time: 0.816660 May 25 14:56:39.156192 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0cb8b0df-5e36-4cdc-beec-9dd4cd18d6f4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:39.178114 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 28/55] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:38 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1360 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:39.197392 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d55c4fb3-2e99-482f-9a9c-28e86e484034 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:39.203516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d55c4fb3-2e99-482f-9a9c-28e86e484034 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:39.223460 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d55c4fb3-2e99-482f-9a9c-28e86e484034 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:39.229759 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d55c4fb3-2e99-482f-9a9c-28e86e484034 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:39.232572 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d55c4fb3-2e99-482f-9a9c-28e86e484034 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:39.235721 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d55c4fb3-2e99-482f-9a9c-28e86e484034 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:39.240188 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-0cb8b0df-5e36-4cdc-beec-9dd4cd18d6f4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Getting quotas for project 9dafcd0df8524413b4fe81a0931323b1. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:56:39.265332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-0cb8b0df-5e36-4cdc-beec-9dd4cd18d6f4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Getting quotas for user e60a5e751f22450c8e366c85b37af1f6 and project 9dafcd0df8524413b4fe81a0931323b1. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:56:39.342841 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-0cb8b0df-5e36-4cdc-beec-9dd4cd18d6f4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Going to run 1 instances... {{(pid=124523) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:56:39.352500 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-0cb8b0df-5e36-4cdc-beec-9dd4cd18d6f4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbec7c78-0103-4632-9a21-d8e8056f2ce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:56:39.538884 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-0cb8b0df-5e36-4cdc-beec-9dd4cd18d6f4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.931276 May 25 14:56:39.555725 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 28/56] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 14:56:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 1953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 14:56:39.571395 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d55e1727-8f30-4c53-bcca-af9c5829822e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:39.573990 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d55e1727-8f30-4c53-bcca-af9c5829822e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:39.614314 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d55e1727-8f30-4c53-bcca-af9c5829822e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:39.622562 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d55e1727-8f30-4c53-bcca-af9c5829822e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:39.627935 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d55e1727-8f30-4c53-bcca-af9c5829822e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:39.629076 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d55e1727-8f30-4c53-bcca-af9c5829822e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:39.831425 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d55c4fb3-2e99-482f-9a9c-28e86e484034 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:39.841423 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d55c4fb3-2e99-482f-9a9c-28e86e484034 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1322 microversion: 2.1 time: 0.661607 May 25 14:56:39.842001 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 29/57] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:39 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1322 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:39.852885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-4eb34cb4-c107-4683-9da8-50bde5ae6d8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:39.853502 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-4eb34cb4-c107-4683-9da8-50bde5ae6d8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:39.893555 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d55e1727-8f30-4c53-bcca-af9c5829822e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:39.913597 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d55e1727-8f30-4c53-bcca-af9c5829822e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1314 microversion: 2.1 time: 0.353497 May 25 14:56:39.914224 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 29/58] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:39 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:39.935086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-3152b53b-ca8f-474c-97b6-739798e03a39 req-a23462b1-a069-48f9-8965-887c19286109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95dc2490-acfb-45bb-b4a6-6bc30f8cf983", "tag": "9735042b-b98e-4620-bbc8-7f7da435ba26"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:39.966449 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-3152b53b-ca8f-474c-97b6-739798e03a39 req-a23462b1-a069-48f9-8965-887c19286109 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:39.967071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-3152b53b-ca8f-474c-97b6-739798e03a39 req-a23462b1-a069-48f9-8965-887c19286109 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:39.997271 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-3152b53b-ca8f-474c-97b6-739798e03a39 req-a23462b1-a069-48f9-8965-887c19286109 service nova] Creating event network-changed:9735042b-b98e-4620-bbc8-7f7da435ba26 for instance 95dc2490-acfb-45bb-b4a6-6bc30f8cf983 on hv-cinder-80382 May 25 14:56:40.006987 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-3152b53b-ca8f-474c-97b6-739798e03a39 req-a23462b1-a069-48f9-8965-887c19286109 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081825 May 25 14:56:40.025911 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 30/59] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:40.102187 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-4eb34cb4-c107-4683-9da8-50bde5ae6d8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:40.127959 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-4eb34cb4-c107-4683-9da8-50bde5ae6d8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1242 microversion: 2.1 time: 0.278974 May 25 14:56:40.129731 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 30/60] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:39 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1242 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:40.182828 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2355f6b2-0411-4d2a-9c2f-e431e7d81285 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:40.184440 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2355f6b2-0411-4d2a-9c2f-e431e7d81285 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:40.224220 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2355f6b2-0411-4d2a-9c2f-e431e7d81285 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:40.224690 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2355f6b2-0411-4d2a-9c2f-e431e7d81285 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:40.234911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2355f6b2-0411-4d2a-9c2f-e431e7d81285 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:40.237245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2355f6b2-0411-4d2a-9c2f-e431e7d81285 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:40.371101 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-c3f2dcd6-abc9-4af2-a7f3-00fc70354650 req-b567d072-32be-4e70-9152-d3d03099e8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2553a433-8b4b-4f36-b319-50c84e8b3d7c", "tag": "21ecf2eb-2386-4559-afdf-cee34a7a8d0c"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:40.391726 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-c3f2dcd6-abc9-4af2-a7f3-00fc70354650 req-b567d072-32be-4e70-9152-d3d03099e8b1 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:40.397876 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-c3f2dcd6-abc9-4af2-a7f3-00fc70354650 req-b567d072-32be-4e70-9152-d3d03099e8b1 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:40.412498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-c3f2dcd6-abc9-4af2-a7f3-00fc70354650 req-b567d072-32be-4e70-9152-d3d03099e8b1 service nova] Creating event network-changed:21ecf2eb-2386-4559-afdf-cee34a7a8d0c for instance 2553a433-8b4b-4f36-b319-50c84e8b3d7c on hv-cinder-80382 May 25 14:56:40.417543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-c3f2dcd6-abc9-4af2-a7f3-00fc70354650 req-b567d072-32be-4e70-9152-d3d03099e8b1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.396137 May 25 14:56:40.419238 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 31/61] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:40.461769 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-2355f6b2-0411-4d2a-9c2f-e431e7d81285 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:40.478716 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2355f6b2-0411-4d2a-9c2f-e431e7d81285 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1360 microversion: 2.1 time: 0.301671 May 25 14:56:40.479595 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 31/62] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:40 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1360 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:40.862174 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-cdff28e6-d322-4240-b6e5-86e302757469 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:40.863170 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-cdff28e6-d322-4240-b6e5-86e302757469 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:40.871870 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cdff28e6-d322-4240-b6e5-86e302757469 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:40.872654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cdff28e6-d322-4240-b6e5-86e302757469 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:40.873728 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cdff28e6-d322-4240-b6e5-86e302757469 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:40.874827 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cdff28e6-d322-4240-b6e5-86e302757469 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:40.935187 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-04b3c872-49c5-4684-b72d-2fff8060ef26 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:40.936821 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-04b3c872-49c5-4684-b72d-2fff8060ef26 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:40.945859 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-04b3c872-49c5-4684-b72d-2fff8060ef26 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:40.946563 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-04b3c872-49c5-4684-b72d-2fff8060ef26 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:40.948039 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-04b3c872-49c5-4684-b72d-2fff8060ef26 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:40.948641 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-04b3c872-49c5-4684-b72d-2fff8060ef26 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:41.165823 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-cdff28e6-d322-4240-b6e5-86e302757469 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:41.176761 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-cdff28e6-d322-4240-b6e5-86e302757469 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1322 microversion: 2.1 time: 0.318804 May 25 14:56:41.183276 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 32/63] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:40 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:41.189509 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-95a1025d-eaa2-4fb7-8ae3-496056c831b1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:41.190699 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-95a1025d-eaa2-4fb7-8ae3-496056c831b1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:41.206155 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-95a1025d-eaa2-4fb7-8ae3-496056c831b1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:41.207000 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-95a1025d-eaa2-4fb7-8ae3-496056c831b1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:41.208470 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-95a1025d-eaa2-4fb7-8ae3-496056c831b1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:41.209038 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-95a1025d-eaa2-4fb7-8ae3-496056c831b1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:41.375601 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-95a1025d-eaa2-4fb7-8ae3-496056c831b1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:41.387915 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-95a1025d-eaa2-4fb7-8ae3-496056c831b1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1246 microversion: 2.1 time: 0.202452 May 25 14:56:41.391663 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 33/64] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:41 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1246 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:41.498252 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f52a9743-db79-48e1-b502-1a317be03757 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:41.499156 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f52a9743-db79-48e1-b502-1a317be03757 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:41.507682 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f52a9743-db79-48e1-b502-1a317be03757 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:41.514562 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f52a9743-db79-48e1-b502-1a317be03757 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:41.518102 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f52a9743-db79-48e1-b502-1a317be03757 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:41.520642 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f52a9743-db79-48e1-b502-1a317be03757 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:41.613660 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-04b3c872-49c5-4684-b72d-2fff8060ef26 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:41.622864 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-04b3c872-49c5-4684-b72d-2fff8060ef26 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1314 microversion: 2.1 time: 0.695343 May 25 14:56:41.623522 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 32/65] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:40 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1314 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:42.203002 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-dd5656c3-bc05-4972-9c10-f186b905da6e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:42.204048 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-dd5656c3-bc05-4972-9c10-f186b905da6e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:42.254098 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dd5656c3-bc05-4972-9c10-f186b905da6e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:42.257670 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dd5656c3-bc05-4972-9c10-f186b905da6e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:42.260828 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dd5656c3-bc05-4972-9c10-f186b905da6e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:42.262905 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dd5656c3-bc05-4972-9c10-f186b905da6e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:42.389018 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f52a9743-db79-48e1-b502-1a317be03757 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:42.409078 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f52a9743-db79-48e1-b502-1a317be03757 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1360 microversion: 2.1 time: 0.914233 May 25 14:56:42.414318 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 34/66] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:41 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1360 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:42.448433 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d446b069-2d97-49a2-83ef-77a1264983ad tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:42.449756 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d446b069-2d97-49a2-83ef-77a1264983ad tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:42.473367 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d446b069-2d97-49a2-83ef-77a1264983ad tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:42.474602 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d446b069-2d97-49a2-83ef-77a1264983ad tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:42.478777 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d446b069-2d97-49a2-83ef-77a1264983ad tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:42.480911 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d446b069-2d97-49a2-83ef-77a1264983ad tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:42.655271 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-dd5656c3-bc05-4972-9c10-f186b905da6e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:42.663561 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-dd5656c3-bc05-4972-9c10-f186b905da6e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1322 microversion: 2.1 time: 0.468105 May 25 14:56:42.664494 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 33/67] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:42 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1322 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:42.669599 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-935b395a-3c84-4df4-8ca6-ebf7d77f145a req-363d22f1-6c44-406b-829f-5a5a0f0e4219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be96576-0efd-4362-8e0d-f74b16ddc912", "tag": "17ca4119-5e7a-4061-9769-ec64b6238082"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:42.670584 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d446b069-2d97-49a2-83ef-77a1264983ad tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:42.680839 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=89 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:42.683330 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-935b395a-3c84-4df4-8ca6-ebf7d77f145a req-363d22f1-6c44-406b-829f-5a5a0f0e4219 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:42.683746 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d446b069-2d97-49a2-83ef-77a1264983ad tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1312 microversion: 2.1 time: 0.267914 May 25 14:56:42.684326 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-935b395a-3c84-4df4-8ca6-ebf7d77f145a req-363d22f1-6c44-406b-829f-5a5a0f0e4219 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:42.684511 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 35/68] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:42 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1312 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:42.699779 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f1091523-2a5f-440d-9e9d-50e837b7ddd2 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:42.700768 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f1091523-2a5f-440d-9e9d-50e837b7ddd2 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:42.718050 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-935b395a-3c84-4df4-8ca6-ebf7d77f145a req-363d22f1-6c44-406b-829f-5a5a0f0e4219 service nova] Creating event network-changed:17ca4119-5e7a-4061-9769-ec64b6238082 for instance 6be96576-0efd-4362-8e0d-f74b16ddc912 on hv-cinder-80382 May 25 14:56:42.718588 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-935b395a-3c84-4df4-8ca6-ebf7d77f145a req-363d22f1-6c44-406b-829f-5a5a0f0e4219 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 25 14:56:42.722597 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dcffce7e-acea-4eca-b08f-f7be39ed242b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:42.725354 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dcffce7e-acea-4eca-b08f-f7be39ed242b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:42.725524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f1091523-2a5f-440d-9e9d-50e837b7ddd2 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:42.727742 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dcffce7e-acea-4eca-b08f-f7be39ed242b None None] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:42.729663 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f1091523-2a5f-440d-9e9d-50e837b7ddd2 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:42.733356 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dcffce7e-acea-4eca-b08f-f7be39ed242b None None] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:42.735061 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f1091523-2a5f-440d-9e9d-50e837b7ddd2 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:42.736149 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f1091523-2a5f-440d-9e9d-50e837b7ddd2 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:42.759504 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.compute.rpcapi [None req-dcffce7e-acea-4eca-b08f-f7be39ed242b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 25 14:56:42.760572 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dcffce7e-acea-4eca-b08f-f7be39ed242b None None] Releasing lock "compute-rpcapi-router" {{(pid=124524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 25 14:56:42.825526 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-dcffce7e-acea-4eca-b08f-f7be39ed242b None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159640 May 25 14:56:42.826311 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 34/69] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:42.946414 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f1091523-2a5f-440d-9e9d-50e837b7ddd2 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:42.956041 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f1091523-2a5f-440d-9e9d-50e837b7ddd2 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1314 microversion: 2.1 time: 0.270433 May 25 14:56:42.957101 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 36/70] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:42 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:43.429906 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-aefef8e2-73d2-4b7f-b1a3-670ffa2b7b99 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:43.430820 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-aefef8e2-73d2-4b7f-b1a3-670ffa2b7b99 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:43.439098 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aefef8e2-73d2-4b7f-b1a3-670ffa2b7b99 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:43.439535 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aefef8e2-73d2-4b7f-b1a3-670ffa2b7b99 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:43.440462 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aefef8e2-73d2-4b7f-b1a3-670ffa2b7b99 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:43.440970 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aefef8e2-73d2-4b7f-b1a3-670ffa2b7b99 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:43.600171 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-aefef8e2-73d2-4b7f-b1a3-670ffa2b7b99 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:43.609910 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-aefef8e2-73d2-4b7f-b1a3-670ffa2b7b99 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1360 microversion: 2.1 time: 0.183991 May 25 14:56:43.609910 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 35/71] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:43 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1360 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:43.685253 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8b62549f-afb8-48fc-b8fc-3f6b3ce1a5a7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:43.687175 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8b62549f-afb8-48fc-b8fc-3f6b3ce1a5a7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:43.708479 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a45386b4-3982-4073-95e4-e65b826533c6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:43.709481 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-a45386b4-3982-4073-95e4-e65b826533c6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:43.716747 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8b62549f-afb8-48fc-b8fc-3f6b3ce1a5a7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:43.717421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8b62549f-afb8-48fc-b8fc-3f6b3ce1a5a7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:43.718464 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8b62549f-afb8-48fc-b8fc-3f6b3ce1a5a7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:43.719189 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8b62549f-afb8-48fc-b8fc-3f6b3ce1a5a7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:43.733154 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a45386b4-3982-4073-95e4-e65b826533c6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:43.733939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a45386b4-3982-4073-95e4-e65b826533c6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:43.735082 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a45386b4-3982-4073-95e4-e65b826533c6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:43.735573 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a45386b4-3982-4073-95e4-e65b826533c6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:43.877214 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-a45386b4-3982-4073-95e4-e65b826533c6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:43.888968 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-a45386b4-3982-4073-95e4-e65b826533c6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1312 microversion: 2.1 time: 0.190591 May 25 14:56:43.889819 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 36/72] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:43 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1312 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:43.916730 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8b62549f-afb8-48fc-b8fc-3f6b3ce1a5a7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:43.924752 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8b62549f-afb8-48fc-b8fc-3f6b3ce1a5a7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1322 microversion: 2.1 time: 0.247524 May 25 14:56:43.925672 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 37/73] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:43 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:43.975453 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-084905a3-b0cc-412d-8509-f47d768638aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:43.976071 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-084905a3-b0cc-412d-8509-f47d768638aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:43.982628 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-084905a3-b0cc-412d-8509-f47d768638aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:43.983081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-084905a3-b0cc-412d-8509-f47d768638aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:43.983921 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-084905a3-b0cc-412d-8509-f47d768638aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:43.984270 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-084905a3-b0cc-412d-8509-f47d768638aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:44.154334 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-084905a3-b0cc-412d-8509-f47d768638aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:44.156663 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=100 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:44.164107 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-084905a3-b0cc-412d-8509-f47d768638aa tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1314 microversion: 2.1 time: 0.192616 May 25 14:56:44.164693 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 37/74] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:43 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:44.629547 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-5b6fdf92-0168-415b-826f-bb26d8b1e18b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:44.630484 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-5b6fdf92-0168-415b-826f-bb26d8b1e18b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:44.637762 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5b6fdf92-0168-415b-826f-bb26d8b1e18b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:44.638273 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5b6fdf92-0168-415b-826f-bb26d8b1e18b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:44.639238 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5b6fdf92-0168-415b-826f-bb26d8b1e18b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:44.639680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5b6fdf92-0168-415b-826f-bb26d8b1e18b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:44.822945 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5b6fdf92-0168-415b-826f-bb26d8b1e18b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:44.832829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-5b6fdf92-0168-415b-826f-bb26d8b1e18b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1360 microversion: 2.1 time: 0.207055 May 25 14:56:44.833414 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 38/75] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:44 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1360 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:44.914556 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-be6bab44-0d0c-43ae-b98a-3a47d640c1c6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:44.916393 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-be6bab44-0d0c-43ae-b98a-3a47d640c1c6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:44.923566 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-be6bab44-0d0c-43ae-b98a-3a47d640c1c6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:44.924020 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-be6bab44-0d0c-43ae-b98a-3a47d640c1c6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:44.924796 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-be6bab44-0d0c-43ae-b98a-3a47d640c1c6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:44.925232 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-be6bab44-0d0c-43ae-b98a-3a47d640c1c6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:44.943987 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-86a4c8f1-3863-48c7-b4ff-e376af3729f3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:44.944519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-86a4c8f1-3863-48c7-b4ff-e376af3729f3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:44.952163 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-86a4c8f1-3863-48c7-b4ff-e376af3729f3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:44.952624 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-86a4c8f1-3863-48c7-b4ff-e376af3729f3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:44.953428 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-86a4c8f1-3863-48c7-b4ff-e376af3729f3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:44.953874 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-86a4c8f1-3863-48c7-b4ff-e376af3729f3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:45.021568 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-be6bab44-0d0c-43ae-b98a-3a47d640c1c6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:45.035217 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-be6bab44-0d0c-43ae-b98a-3a47d640c1c6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1312 microversion: 2.1 time: 0.124309 May 25 14:56:45.035825 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 38/76] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:44 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1312 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:45.114213 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-86a4c8f1-3863-48c7-b4ff-e376af3729f3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:45.125845 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-86a4c8f1-3863-48c7-b4ff-e376af3729f3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1322 microversion: 2.1 time: 0.185859 May 25 14:56:45.126985 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 39/77] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:44 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:45.180765 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-97ddfde8-0ded-47f2-b026-cef49ad883e1 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:45.181677 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-97ddfde8-0ded-47f2-b026-cef49ad883e1 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:45.189019 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-97ddfde8-0ded-47f2-b026-cef49ad883e1 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:45.189895 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-97ddfde8-0ded-47f2-b026-cef49ad883e1 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:45.190918 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-97ddfde8-0ded-47f2-b026-cef49ad883e1 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:45.191595 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-97ddfde8-0ded-47f2-b026-cef49ad883e1 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:45.366622 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-97ddfde8-0ded-47f2-b026-cef49ad883e1 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:45.376336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-97ddfde8-0ded-47f2-b026-cef49ad883e1 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1314 microversion: 2.1 time: 0.199386 May 25 14:56:45.385532 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 39/78] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:45 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:45.856457 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f3fb5e57-7ef5-4b14-aebf-b03ff11c41c8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:45.857082 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f3fb5e57-7ef5-4b14-aebf-b03ff11c41c8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:45.864274 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f3fb5e57-7ef5-4b14-aebf-b03ff11c41c8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:45.864755 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f3fb5e57-7ef5-4b14-aebf-b03ff11c41c8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:45.865531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f3fb5e57-7ef5-4b14-aebf-b03ff11c41c8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:45.865965 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f3fb5e57-7ef5-4b14-aebf-b03ff11c41c8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:46.023392 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f3fb5e57-7ef5-4b14-aebf-b03ff11c41c8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:46.032033 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f3fb5e57-7ef5-4b14-aebf-b03ff11c41c8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1360 microversion: 2.1 time: 0.180544 May 25 14:56:46.032620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 40/79] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:45 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1360 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:46.053134 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-393da0f9-9f57-42d6-b3bf-12e97bcb611e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:46.054349 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-393da0f9-9f57-42d6-b3bf-12e97bcb611e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:46.067878 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-393da0f9-9f57-42d6-b3bf-12e97bcb611e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:46.067878 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-393da0f9-9f57-42d6-b3bf-12e97bcb611e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:46.067878 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-393da0f9-9f57-42d6-b3bf-12e97bcb611e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:46.067878 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-393da0f9-9f57-42d6-b3bf-12e97bcb611e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:46.133557 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-393da0f9-9f57-42d6-b3bf-12e97bcb611e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:46.145316 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-393da0f9-9f57-42d6-b3bf-12e97bcb611e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1312 microversion: 2.1 time: 0.094421 May 25 14:56:46.145914 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 40/80] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:46 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:46.157647 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d72746c8-f2f5-49e9-a7fc-6f86263516b5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:46.158419 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d72746c8-f2f5-49e9-a7fc-6f86263516b5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:46.164608 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d72746c8-f2f5-49e9-a7fc-6f86263516b5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:46.165132 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d72746c8-f2f5-49e9-a7fc-6f86263516b5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:46.166120 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d72746c8-f2f5-49e9-a7fc-6f86263516b5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:46.166779 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d72746c8-f2f5-49e9-a7fc-6f86263516b5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:46.304840 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d72746c8-f2f5-49e9-a7fc-6f86263516b5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:46.314378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d72746c8-f2f5-49e9-a7fc-6f86263516b5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1322 microversion: 2.1 time: 0.171968 May 25 14:56:46.315443 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 41/81] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:46 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:46.393508 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-5bbae543-dbd4-475f-83d9-cc63f4580d57 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:46.394734 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-5bbae543-dbd4-475f-83d9-cc63f4580d57 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:46.402117 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5bbae543-dbd4-475f-83d9-cc63f4580d57 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:46.403376 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5bbae543-dbd4-475f-83d9-cc63f4580d57 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:46.404364 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5bbae543-dbd4-475f-83d9-cc63f4580d57 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:46.404975 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5bbae543-dbd4-475f-83d9-cc63f4580d57 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:46.566221 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-5bbae543-dbd4-475f-83d9-cc63f4580d57 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:46.585924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-5bbae543-dbd4-475f-83d9-cc63f4580d57 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1314 microversion: 2.1 time: 0.195859 May 25 14:56:46.587489 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 41/82] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:46 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:46.944928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-da769515-eb14-48c7-b377-0a8b813aa44f req-f0358dfa-6d2f-422b-984c-47d3f6595a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f7ac9b-d086-4fd8-ad74-1389a710a8b9", "name": "network-vif-plugged", "status": "completed", "tag": "f1103ce0-8308-4eee-ba41-b299b65a288b"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:46.955343 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-da769515-eb14-48c7-b377-0a8b813aa44f req-f0358dfa-6d2f-422b-984c-47d3f6595a0e service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:46.955781 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-da769515-eb14-48c7-b377-0a8b813aa44f req-f0358dfa-6d2f-422b-984c-47d3f6595a0e service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:46.973401 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-da769515-eb14-48c7-b377-0a8b813aa44f req-f0358dfa-6d2f-422b-984c-47d3f6595a0e service nova] Creating event network-vif-plugged:f1103ce0-8308-4eee-ba41-b299b65a288b for instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 on hv-cinder-80382 May 25 14:56:46.978539 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-da769515-eb14-48c7-b377-0a8b813aa44f req-f0358dfa-6d2f-422b-984c-47d3f6595a0e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239615 May 25 14:56:46.979321 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 42/83] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:47.054830 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a20c4fb8-9b05-4ecf-b0e7-09cb60febdf3 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:47.056437 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-a20c4fb8-9b05-4ecf-b0e7-09cb60febdf3 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:47.068630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a20c4fb8-9b05-4ecf-b0e7-09cb60febdf3 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:47.069485 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a20c4fb8-9b05-4ecf-b0e7-09cb60febdf3 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:47.071142 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a20c4fb8-9b05-4ecf-b0e7-09cb60febdf3 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:47.072278 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a20c4fb8-9b05-4ecf-b0e7-09cb60febdf3 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:47.169461 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a239ecdc-45c8-4432-bd01-06e6cb6e5422 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:47.170214 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a239ecdc-45c8-4432-bd01-06e6cb6e5422 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:47.192951 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a239ecdc-45c8-4432-bd01-06e6cb6e5422 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:47.193411 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a239ecdc-45c8-4432-bd01-06e6cb6e5422 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:47.194996 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a239ecdc-45c8-4432-bd01-06e6cb6e5422 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:47.195802 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a239ecdc-45c8-4432-bd01-06e6cb6e5422 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:47.316274 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a239ecdc-45c8-4432-bd01-06e6cb6e5422 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:47.328078 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a239ecdc-45c8-4432-bd01-06e6cb6e5422 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1300 microversion: 2.1 time: 0.169145 May 25 14:56:47.330866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 43/84] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:47 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1300 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:47.335805 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-869d6fe4-da31-4d56-9898-150632484422 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:47.336416 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-869d6fe4-da31-4d56-9898-150632484422 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:47.361171 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-869d6fe4-da31-4d56-9898-150632484422 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:47.362885 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-869d6fe4-da31-4d56-9898-150632484422 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:47.364223 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-869d6fe4-da31-4d56-9898-150632484422 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:47.366986 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-869d6fe4-da31-4d56-9898-150632484422 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:47.799508 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-869d6fe4-da31-4d56-9898-150632484422 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:47.807907 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-869d6fe4-da31-4d56-9898-150632484422 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1322 microversion: 2.1 time: 0.475639 May 25 14:56:47.808747 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 44/85] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:47 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1322 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:47.814063 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-08c943e3-0a9a-4d2d-92b3-3fd5dfd19160 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:47.814885 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-08c943e3-0a9a-4d2d-92b3-3fd5dfd19160 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:47.821449 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-08c943e3-0a9a-4d2d-92b3-3fd5dfd19160 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:47.822138 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-08c943e3-0a9a-4d2d-92b3-3fd5dfd19160 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:47.823094 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-08c943e3-0a9a-4d2d-92b3-3fd5dfd19160 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:47.823810 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-08c943e3-0a9a-4d2d-92b3-3fd5dfd19160 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:47.867706 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-a20c4fb8-9b05-4ecf-b0e7-09cb60febdf3 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:47.886060 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-a20c4fb8-9b05-4ecf-b0e7-09cb60febdf3 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1360 microversion: 2.1 time: 0.839794 May 25 14:56:47.887825 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 42/86] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:47 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1360 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:48.353954 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-95db1946-e1d4-4995-9e3e-d6021b1fd90c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:48.357095 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-95db1946-e1d4-4995-9e3e-d6021b1fd90c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:48.388794 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-95db1946-e1d4-4995-9e3e-d6021b1fd90c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:48.388980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-95db1946-e1d4-4995-9e3e-d6021b1fd90c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:48.394917 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-95db1946-e1d4-4995-9e3e-d6021b1fd90c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:48.395783 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-95db1946-e1d4-4995-9e3e-d6021b1fd90c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:48.543519 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-95db1946-e1d4-4995-9e3e-d6021b1fd90c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:48.559609 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-95db1946-e1d4-4995-9e3e-d6021b1fd90c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1300 microversion: 2.1 time: 0.212147 May 25 14:56:48.561037 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 43/87] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:48 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1300 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:48.686709 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-08c943e3-0a9a-4d2d-92b3-3fd5dfd19160 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:48.698382 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-08c943e3-0a9a-4d2d-92b3-3fd5dfd19160 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1314 microversion: 2.1 time: 0.888082 May 25 14:56:48.700074 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 45/88] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:47 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1314 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:48.825547 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-9b4db798-36ed-4962-a897-99030c2f1075 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:48.827279 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-9b4db798-36ed-4962-a897-99030c2f1075 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:48.835632 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9b4db798-36ed-4962-a897-99030c2f1075 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:48.836078 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9b4db798-36ed-4962-a897-99030c2f1075 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:48.837055 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9b4db798-36ed-4962-a897-99030c2f1075 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:48.837757 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9b4db798-36ed-4962-a897-99030c2f1075 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:48.910824 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-baf7f901-56b6-46ca-93be-b30891b305d2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:48.912560 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-baf7f901-56b6-46ca-93be-b30891b305d2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:48.922318 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-baf7f901-56b6-46ca-93be-b30891b305d2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:48.922682 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-baf7f901-56b6-46ca-93be-b30891b305d2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:48.925249 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-baf7f901-56b6-46ca-93be-b30891b305d2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:48.926549 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-baf7f901-56b6-46ca-93be-b30891b305d2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:49.028105 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-9b4db798-36ed-4962-a897-99030c2f1075 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:49.036966 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-9b4db798-36ed-4962-a897-99030c2f1075 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1322 microversion: 2.1 time: 0.215987 May 25 14:56:49.050415 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 44/89] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:48 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:49.196753 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=6 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:49.262856 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-baf7f901-56b6-46ca-93be-b30891b305d2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:49.274237 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-baf7f901-56b6-46ca-93be-b30891b305d2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1360 microversion: 2.1 time: 0.373377 May 25 14:56:49.275297 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 46/90] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:48 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1360 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:49.579062 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-cf78f067-37cc-49d6-8dcd-43a794765522 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:49.580139 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-cf78f067-37cc-49d6-8dcd-43a794765522 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:49.594315 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cf78f067-37cc-49d6-8dcd-43a794765522 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:49.595107 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cf78f067-37cc-49d6-8dcd-43a794765522 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:49.596773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cf78f067-37cc-49d6-8dcd-43a794765522 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:49.597410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cf78f067-37cc-49d6-8dcd-43a794765522 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:49.721794 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e677b96f-c32c-4435-b0b2-6f509e9e9f04 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:49.722543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e677b96f-c32c-4435-b0b2-6f509e9e9f04 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:49.724549 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=18 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:49.731059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e677b96f-c32c-4435-b0b2-6f509e9e9f04 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:49.731586 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e677b96f-c32c-4435-b0b2-6f509e9e9f04 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:49.732584 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e677b96f-c32c-4435-b0b2-6f509e9e9f04 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:49.733114 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e677b96f-c32c-4435-b0b2-6f509e9e9f04 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:49.742066 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-cf78f067-37cc-49d6-8dcd-43a794765522 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:49.752452 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-cf78f067-37cc-49d6-8dcd-43a794765522 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.179219 May 25 14:56:49.753242 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 45/91] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:49 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:49.878416 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e677b96f-c32c-4435-b0b2-6f509e9e9f04 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:49.887068 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e677b96f-c32c-4435-b0b2-6f509e9e9f04 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1314 microversion: 2.1 time: 0.173210 May 25 14:56:49.887657 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 47/92] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:49 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:50.061219 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-dccccc62-8723-45aa-b907-face924e81dc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:50.061832 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-dccccc62-8723-45aa-b907-face924e81dc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:50.067922 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dccccc62-8723-45aa-b907-face924e81dc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:50.068681 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dccccc62-8723-45aa-b907-face924e81dc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:50.069125 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dccccc62-8723-45aa-b907-face924e81dc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:50.069559 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dccccc62-8723-45aa-b907-face924e81dc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:50.120329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:50.206926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-dccccc62-8723-45aa-b907-face924e81dc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:50.214676 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-dccccc62-8723-45aa-b907-face924e81dc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1322 microversion: 2.1 time: 0.157681 May 25 14:56:50.215347 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 46/93] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:50 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:50.291738 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-cf8c3622-a1cd-435f-b4c3-2735315143b9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:50.293301 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-cf8c3622-a1cd-435f-b4c3-2735315143b9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:50.299724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cf8c3622-a1cd-435f-b4c3-2735315143b9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:50.300368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cf8c3622-a1cd-435f-b4c3-2735315143b9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:50.301137 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cf8c3622-a1cd-435f-b4c3-2735315143b9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:50.301714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cf8c3622-a1cd-435f-b4c3-2735315143b9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:50.688319 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-cf8c3622-a1cd-435f-b4c3-2735315143b9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:50.702960 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-cf8c3622-a1cd-435f-b4c3-2735315143b9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1360 microversion: 2.1 time: 0.412830 May 25 14:56:50.703841 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 48/94] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:50 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1360 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:50.772711 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-57a775fa-b2fa-4110-b407-8a6db4884dc7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:50.773378 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-57a775fa-b2fa-4110-b407-8a6db4884dc7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:50.797592 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-7b3f623e-f00b-42dd-b0b2-10805a231c28 req-bcb30a93-7e39-4fa4-a72a-73fd14d535e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be96576-0efd-4362-8e0d-f74b16ddc912", "name": "network-vif-plugged", "status": "completed", "tag": "17ca4119-5e7a-4061-9769-ec64b6238082"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:50.805233 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-57a775fa-b2fa-4110-b407-8a6db4884dc7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:50.805750 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-57a775fa-b2fa-4110-b407-8a6db4884dc7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:50.809848 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-57a775fa-b2fa-4110-b407-8a6db4884dc7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:50.810295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-57a775fa-b2fa-4110-b407-8a6db4884dc7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:50.819032 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-7b3f623e-f00b-42dd-b0b2-10805a231c28 req-bcb30a93-7e39-4fa4-a72a-73fd14d535e1 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:50.819478 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-7b3f623e-f00b-42dd-b0b2-10805a231c28 req-bcb30a93-7e39-4fa4-a72a-73fd14d535e1 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:50.846407 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-7b3f623e-f00b-42dd-b0b2-10805a231c28 req-bcb30a93-7e39-4fa4-a72a-73fd14d535e1 service nova] Creating event network-vif-plugged:17ca4119-5e7a-4061-9769-ec64b6238082 for instance 6be96576-0efd-4362-8e0d-f74b16ddc912 on hv-cinder-80382 May 25 14:56:50.857278 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-7b3f623e-f00b-42dd-b0b2-10805a231c28 req-bcb30a93-7e39-4fa4-a72a-73fd14d535e1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064222 May 25 14:56:50.860051 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 49/95] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:50.918979 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-396f9395-fc8e-43dd-96bd-e36b3300478f tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:50.921198 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-396f9395-fc8e-43dd-96bd-e36b3300478f tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:50.955161 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-396f9395-fc8e-43dd-96bd-e36b3300478f tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:50.957506 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-396f9395-fc8e-43dd-96bd-e36b3300478f tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:50.963844 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-396f9395-fc8e-43dd-96bd-e36b3300478f tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:50.965600 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-396f9395-fc8e-43dd-96bd-e36b3300478f tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:51.134368 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-57a775fa-b2fa-4110-b407-8a6db4884dc7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:51.150534 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-57a775fa-b2fa-4110-b407-8a6db4884dc7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.384234 May 25 14:56:51.151326 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 47/96] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:50 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:51.233406 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0f56e624-3975-4212-b7aa-4d7f3ad8faa7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:51.234591 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0f56e624-3975-4212-b7aa-4d7f3ad8faa7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:51.255480 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0f56e624-3975-4212-b7aa-4d7f3ad8faa7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:51.256097 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0f56e624-3975-4212-b7aa-4d7f3ad8faa7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:51.258987 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0f56e624-3975-4212-b7aa-4d7f3ad8faa7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:51.259368 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0f56e624-3975-4212-b7aa-4d7f3ad8faa7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:51.348813 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-396f9395-fc8e-43dd-96bd-e36b3300478f tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:51.360386 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-396f9395-fc8e-43dd-96bd-e36b3300478f tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1314 microversion: 2.1 time: 0.458814 May 25 14:56:51.370753 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 50/97] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:50 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:51.529663 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-0f56e624-3975-4212-b7aa-4d7f3ad8faa7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:51.539505 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0f56e624-3975-4212-b7aa-4d7f3ad8faa7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1322 microversion: 2.1 time: 0.310912 May 25 14:56:51.540812 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 48/98] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:51 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:51.721950 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-121d0a80-0403-48c8-a035-9d752f55322e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:51.723086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-121d0a80-0403-48c8-a035-9d752f55322e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:51.729541 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-121d0a80-0403-48c8-a035-9d752f55322e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:51.730269 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-121d0a80-0403-48c8-a035-9d752f55322e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:51.731208 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-121d0a80-0403-48c8-a035-9d752f55322e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:51.731803 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-121d0a80-0403-48c8-a035-9d752f55322e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:52.087355 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-4b473c01-e93b-4a68-8f58-6431e19aba41 req-a72c7ad6-227e-4656-896d-694b715377c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a0babe-e62d-4dd3-8642-7c049a6236a3", "tag": "16bf1466-e269-4b11-ae5a-74bda30dcb22"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:52.106382 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-121d0a80-0403-48c8-a035-9d752f55322e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:52.111439 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-4b473c01-e93b-4a68-8f58-6431e19aba41 req-a72c7ad6-227e-4656-896d-694b715377c4 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:52.116553 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-4b473c01-e93b-4a68-8f58-6431e19aba41 req-a72c7ad6-227e-4656-896d-694b715377c4 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:52.125218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-121d0a80-0403-48c8-a035-9d752f55322e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1360 microversion: 2.1 time: 0.398611 May 25 14:56:52.129330 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 51/99] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:51 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1360 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:52.148431 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-4b473c01-e93b-4a68-8f58-6431e19aba41 req-a72c7ad6-227e-4656-896d-694b715377c4 service nova] Creating event network-changed:16bf1466-e269-4b11-ae5a-74bda30dcb22 for instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 on hv-cinder-80382 May 25 14:56:52.154867 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-4b473c01-e93b-4a68-8f58-6431e19aba41 req-a72c7ad6-227e-4656-896d-694b715377c4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092510 May 25 14:56:52.155891 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 49/100] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:52.175431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-11ed2b1a-46d5-4869-8b11-e8d11efead43 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:52.176195 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-11ed2b1a-46d5-4869-8b11-e8d11efead43 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:52.198126 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-11ed2b1a-46d5-4869-8b11-e8d11efead43 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:52.200710 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-11ed2b1a-46d5-4869-8b11-e8d11efead43 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:52.201990 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-11ed2b1a-46d5-4869-8b11-e8d11efead43 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:52.202643 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-11ed2b1a-46d5-4869-8b11-e8d11efead43 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:52.379841 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a36769a6-1be2-4aa0-bf8b-a725a1dd76f9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:52.380859 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-a36769a6-1be2-4aa0-bf8b-a725a1dd76f9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:52.398970 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a36769a6-1be2-4aa0-bf8b-a725a1dd76f9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:52.399781 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a36769a6-1be2-4aa0-bf8b-a725a1dd76f9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:52.405346 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a36769a6-1be2-4aa0-bf8b-a725a1dd76f9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:52.407064 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a36769a6-1be2-4aa0-bf8b-a725a1dd76f9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:52.553155 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-11ed2b1a-46d5-4869-8b11-e8d11efead43 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:52.565880 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-11ed2b1a-46d5-4869-8b11-e8d11efead43 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.401028 May 25 14:56:52.566509 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 52/101] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:52 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:52.584584 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-6dc40441-1412-4730-81e6-22b487228116 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:52.585557 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-6dc40441-1412-4730-81e6-22b487228116 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:52.595850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6dc40441-1412-4730-81e6-22b487228116 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:52.596700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6dc40441-1412-4730-81e6-22b487228116 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:52.598460 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6dc40441-1412-4730-81e6-22b487228116 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:52.600724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6dc40441-1412-4730-81e6-22b487228116 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:52.756951 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-a36769a6-1be2-4aa0-bf8b-a725a1dd76f9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:52.780057 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:52.788144 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-6dc40441-1412-4730-81e6-22b487228116 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:52.797095 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-a36769a6-1be2-4aa0-bf8b-a725a1dd76f9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1314 microversion: 2.1 time: 0.420915 May 25 14:56:52.797795 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=100 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:52.798583 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 50/102] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:52 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:52.801893 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-6dc40441-1412-4730-81e6-22b487228116 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1322 microversion: 2.1 time: 0.233237 May 25 14:56:52.803407 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 53/103] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:52 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:53.023469 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-96da2b28-0bef-4e90-8897-066c56783ab1 req-658becf6-2c94-4bd4-a89c-7b19ae534382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95dc2490-acfb-45bb-b4a6-6bc30f8cf983", "name": "network-vif-plugged", "status": "completed", "tag": "9735042b-b98e-4620-bbc8-7f7da435ba26"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:53.034882 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-96da2b28-0bef-4e90-8897-066c56783ab1 req-658becf6-2c94-4bd4-a89c-7b19ae534382 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:53.035528 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-96da2b28-0bef-4e90-8897-066c56783ab1 req-658becf6-2c94-4bd4-a89c-7b19ae534382 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:53.057785 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-96da2b28-0bef-4e90-8897-066c56783ab1 req-658becf6-2c94-4bd4-a89c-7b19ae534382 service nova] Creating event network-vif-plugged:9735042b-b98e-4620-bbc8-7f7da435ba26 for instance 95dc2490-acfb-45bb-b4a6-6bc30f8cf983 on hv-cinder-80382 May 25 14:56:53.063738 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-96da2b28-0bef-4e90-8897-066c56783ab1 req-658becf6-2c94-4bd4-a89c-7b19ae534382 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045278 May 25 14:56:53.067888 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 51/104] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:53.151301 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-fd39defe-d5dc-4a1f-9eae-1c6d6d384274 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:53.152096 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-fd39defe-d5dc-4a1f-9eae-1c6d6d384274 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:53.161895 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fd39defe-d5dc-4a1f-9eae-1c6d6d384274 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:53.162415 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fd39defe-d5dc-4a1f-9eae-1c6d6d384274 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:53.163860 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fd39defe-d5dc-4a1f-9eae-1c6d6d384274 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:53.164383 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fd39defe-d5dc-4a1f-9eae-1c6d6d384274 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:53.588649 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0f0eb5ee-a8dc-45a2-8ee0-0f8bbea302f0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:53.591846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0f0eb5ee-a8dc-45a2-8ee0-0f8bbea302f0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:53.611442 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0f0eb5ee-a8dc-45a2-8ee0-0f8bbea302f0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:53.612393 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0f0eb5ee-a8dc-45a2-8ee0-0f8bbea302f0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:53.615675 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0f0eb5ee-a8dc-45a2-8ee0-0f8bbea302f0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:53.617198 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0f0eb5ee-a8dc-45a2-8ee0-0f8bbea302f0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:53.633829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-fd39defe-d5dc-4a1f-9eae-1c6d6d384274 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:53.659136 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-fd39defe-d5dc-4a1f-9eae-1c6d6d384274 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1360 microversion: 2.1 time: 0.510881 May 25 14:56:53.661409 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 54/105] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:53 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1360 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:53.816450 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e0d85b33-3871-4d76-9477-680bab1f0156 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:53.817694 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e0d85b33-3871-4d76-9477-680bab1f0156 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:53.826030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e0d85b33-3871-4d76-9477-680bab1f0156 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:53.827313 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e0d85b33-3871-4d76-9477-680bab1f0156 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:53.828386 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e0d85b33-3871-4d76-9477-680bab1f0156 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:53.829021 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e0d85b33-3871-4d76-9477-680bab1f0156 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:53.934850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-0f0eb5ee-a8dc-45a2-8ee0-0f8bbea302f0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:53.945257 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0f0eb5ee-a8dc-45a2-8ee0-0f8bbea302f0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.363679 May 25 14:56:53.946107 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 52/106] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:53 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:53.955806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a0743a20-e426-44c4-93e6-277bfe8c1cd3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:53.956784 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-a0743a20-e426-44c4-93e6-277bfe8c1cd3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:53.983011 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a0743a20-e426-44c4-93e6-277bfe8c1cd3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:53.985913 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a0743a20-e426-44c4-93e6-277bfe8c1cd3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:53.987604 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a0743a20-e426-44c4-93e6-277bfe8c1cd3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:53.989231 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a0743a20-e426-44c4-93e6-277bfe8c1cd3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:54.116721 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e0d85b33-3871-4d76-9477-680bab1f0156 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:54.126406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e0d85b33-3871-4d76-9477-680bab1f0156 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1500 microversion: 2.1 time: 0.313758 May 25 14:56:54.130422 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 55/107] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:53 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1500 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:54.262744 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-a0743a20-e426-44c4-93e6-277bfe8c1cd3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:54.272148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-a0743a20-e426-44c4-93e6-277bfe8c1cd3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1322 microversion: 2.1 time: 0.322474 May 25 14:56:54.273065 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 53/108] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:53 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:54.682843 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-85b10230-b9cd-4891-9419-79eb863b7abe tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:54.685714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-85b10230-b9cd-4891-9419-79eb863b7abe tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:54.701599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-85b10230-b9cd-4891-9419-79eb863b7abe tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:54.702366 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-85b10230-b9cd-4891-9419-79eb863b7abe tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:54.704122 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-85b10230-b9cd-4891-9419-79eb863b7abe tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:54.705283 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-85b10230-b9cd-4891-9419-79eb863b7abe tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:54.932174 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-85b10230-b9cd-4891-9419-79eb863b7abe tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:54.942389 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-85b10230-b9cd-4891-9419-79eb863b7abe tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1360 microversion: 2.1 time: 0.265316 May 25 14:56:54.947052 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 56/109] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:54 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1360 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:54.962039 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-71b814c5-4a8b-4c1a-aa3a-e6274de00acb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:54.962748 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-71b814c5-4a8b-4c1a-aa3a-e6274de00acb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:54.972568 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-71b814c5-4a8b-4c1a-aa3a-e6274de00acb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:54.974591 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-71b814c5-4a8b-4c1a-aa3a-e6274de00acb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:54.975569 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-71b814c5-4a8b-4c1a-aa3a-e6274de00acb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:54.978502 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-71b814c5-4a8b-4c1a-aa3a-e6274de00acb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:55.103562 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-ed2cd03b-f1d5-4ce4-a148-f3e256bcab96 req-34a7d8b6-df08-4515-a9a9-4663587161b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2553a433-8b4b-4f36-b319-50c84e8b3d7c", "name": "network-vif-plugged", "status": "completed", "tag": "21ecf2eb-2386-4559-afdf-cee34a7a8d0c"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:55.130494 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-ed2cd03b-f1d5-4ce4-a148-f3e256bcab96 req-34a7d8b6-df08-4515-a9a9-4663587161b8 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:55.132110 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-ed2cd03b-f1d5-4ce4-a148-f3e256bcab96 req-34a7d8b6-df08-4515-a9a9-4663587161b8 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:55.160367 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-ed2cd03b-f1d5-4ce4-a148-f3e256bcab96 req-34a7d8b6-df08-4515-a9a9-4663587161b8 service nova] Creating event network-vif-plugged:21ecf2eb-2386-4559-afdf-cee34a7a8d0c for instance 2553a433-8b4b-4f36-b319-50c84e8b3d7c on hv-cinder-80382 May 25 14:56:55.176862 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-ed2cd03b-f1d5-4ce4-a148-f3e256bcab96 req-34a7d8b6-df08-4515-a9a9-4663587161b8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075850 May 25 14:56:55.177520 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 57/110] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:56:55.184241 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-71b814c5-4a8b-4c1a-aa3a-e6274de00acb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:55.193089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-71b814c5-4a8b-4c1a-aa3a-e6274de00acb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.234703 May 25 14:56:55.198067 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 54/111] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:54 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:55.292944 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-34b00cb0-f3b9-4dde-bf6f-5e80d6e812f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:55.293845 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-34b00cb0-f3b9-4dde-bf6f-5e80d6e812f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:55.300752 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-34b00cb0-f3b9-4dde-bf6f-5e80d6e812f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:55.301187 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-34b00cb0-f3b9-4dde-bf6f-5e80d6e812f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:55.301958 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-34b00cb0-f3b9-4dde-bf6f-5e80d6e812f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:55.302429 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-34b00cb0-f3b9-4dde-bf6f-5e80d6e812f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:55.688938 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-080e5254-e546-4b6b-b2a5-b2c5de264f2b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3353c94a-b680-467b-9880-4e4a1ec9d49a"}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:55.690894 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-080e5254-e546-4b6b-b2a5-b2c5de264f2b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:55.697600 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-080e5254-e546-4b6b-b2a5-b2c5de264f2b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:55.698254 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-080e5254-e546-4b6b-b2a5-b2c5de264f2b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:55.700028 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-080e5254-e546-4b6b-b2a5-b2c5de264f2b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:55.700679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-080e5254-e546-4b6b-b2a5-b2c5de264f2b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:55.712451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-34b00cb0-f3b9-4dde-bf6f-5e80d6e812f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:55.722993 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-34b00cb0-f3b9-4dde-bf6f-5e80d6e812f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1322 microversion: 2.1 time: 0.434696 May 25 14:56:55.723983 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 58/112] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:55 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1322 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:55.841364 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=100 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:55.961059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e17ea073-cc7f-4258-865b-558967f389e7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:55.961669 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e17ea073-cc7f-4258-865b-558967f389e7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:55.968262 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e17ea073-cc7f-4258-865b-558967f389e7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:55.968684 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e17ea073-cc7f-4258-865b-558967f389e7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:55.969445 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e17ea073-cc7f-4258-865b-558967f389e7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:55.969866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e17ea073-cc7f-4258-865b-558967f389e7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:56.115945 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e17ea073-cc7f-4258-865b-558967f389e7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:56.124420 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e17ea073-cc7f-4258-865b-558967f389e7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1360 microversion: 2.1 time: 0.166977 May 25 14:56:56.125423 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 59/113] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:55 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1360 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:56.212761 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b487115c-857a-4fc1-b067-e2d56a9b98e7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:56.213233 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-b487115c-857a-4fc1-b067-e2d56a9b98e7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:56.220706 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b487115c-857a-4fc1-b067-e2d56a9b98e7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:56.221294 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b487115c-857a-4fc1-b067-e2d56a9b98e7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:56.222216 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b487115c-857a-4fc1-b067-e2d56a9b98e7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:56.223130 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b487115c-857a-4fc1-b067-e2d56a9b98e7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:56.371296 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-b487115c-857a-4fc1-b067-e2d56a9b98e7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:56.379995 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-b487115c-857a-4fc1-b067-e2d56a9b98e7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.172303 May 25 14:56:56.380758 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 60/114] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:56 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:56.740014 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8736adc7-7a3f-4139-9bf9-56f60e5f14cf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:56.740657 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8736adc7-7a3f-4139-9bf9-56f60e5f14cf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:56.747965 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8736adc7-7a3f-4139-9bf9-56f60e5f14cf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:56.748416 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8736adc7-7a3f-4139-9bf9-56f60e5f14cf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:56.749191 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8736adc7-7a3f-4139-9bf9-56f60e5f14cf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:56.749626 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8736adc7-7a3f-4139-9bf9-56f60e5f14cf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:56.926847 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8736adc7-7a3f-4139-9bf9-56f60e5f14cf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:56.939706 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8736adc7-7a3f-4139-9bf9-56f60e5f14cf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1322 microversion: 2.1 time: 0.203549 May 25 14:56:56.940297 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 61/115] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:56 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:57.140600 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-7db9dea4-d292-4293-870f-e615ec545f2b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:57.141339 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-7db9dea4-d292-4293-870f-e615ec545f2b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:57.147605 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7db9dea4-d292-4293-870f-e615ec545f2b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:57.148122 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7db9dea4-d292-4293-870f-e615ec545f2b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:57.148954 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7db9dea4-d292-4293-870f-e615ec545f2b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:57.149451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7db9dea4-d292-4293-870f-e615ec545f2b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:57.309386 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-7db9dea4-d292-4293-870f-e615ec545f2b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:57.318197 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-7db9dea4-d292-4293-870f-e615ec545f2b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1360 microversion: 2.1 time: 0.181344 May 25 14:56:57.318793 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 62/116] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:57 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1360 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:57.399884 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f7928570-7597-4516-b725-c40758259485 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:57.400740 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f7928570-7597-4516-b725-c40758259485 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:57.410895 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f7928570-7597-4516-b725-c40758259485 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:57.411616 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f7928570-7597-4516-b725-c40758259485 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:57.412611 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f7928570-7597-4516-b725-c40758259485 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:57.413177 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f7928570-7597-4516-b725-c40758259485 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:57.556442 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f7928570-7597-4516-b725-c40758259485 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:57.567036 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f7928570-7597-4516-b725-c40758259485 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.171778 May 25 14:56:57.569433 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 63/117] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:57 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:57.961659 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-35cced3c-567f-4b4a-a785-f8cc0d84618b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:57.962965 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-35cced3c-567f-4b4a-a785-f8cc0d84618b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:57.970291 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-35cced3c-567f-4b4a-a785-f8cc0d84618b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:57.970740 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-35cced3c-567f-4b4a-a785-f8cc0d84618b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:57.971528 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-35cced3c-567f-4b4a-a785-f8cc0d84618b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:57.971972 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-35cced3c-567f-4b4a-a785-f8cc0d84618b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:58.160574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-35cced3c-567f-4b4a-a785-f8cc0d84618b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:58.168991 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-35cced3c-567f-4b4a-a785-f8cc0d84618b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1322 microversion: 2.1 time: 0.215662 May 25 14:56:58.170246 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 64/118] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:57 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:58.337351 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4ffa8a32-84fb-47e4-ab4d-9f1ecdb17762 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:58.338110 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4ffa8a32-84fb-47e4-ab4d-9f1ecdb17762 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:58.345003 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4ffa8a32-84fb-47e4-ab4d-9f1ecdb17762 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:58.345569 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4ffa8a32-84fb-47e4-ab4d-9f1ecdb17762 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:58.346448 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4ffa8a32-84fb-47e4-ab4d-9f1ecdb17762 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:58.346951 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4ffa8a32-84fb-47e4-ab4d-9f1ecdb17762 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:58.490480 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4ffa8a32-84fb-47e4-ab4d-9f1ecdb17762 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:58.499552 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4ffa8a32-84fb-47e4-ab4d-9f1ecdb17762 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1545 microversion: 2.1 time: 0.166642 May 25 14:56:58.523242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 65/119] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:58 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1545 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:58.531078 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d88dee71-63d0-4fd4-a3d8-c84f8f75205e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:58.531835 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d88dee71-63d0-4fd4-a3d8-c84f8f75205e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:58.540094 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:58.541865 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d88dee71-63d0-4fd4-a3d8-c84f8f75205e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:58.542520 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d88dee71-63d0-4fd4-a3d8-c84f8f75205e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:58.543463 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d88dee71-63d0-4fd4-a3d8-c84f8f75205e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:58.544172 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d88dee71-63d0-4fd4-a3d8-c84f8f75205e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:58.701134 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d88dee71-63d0-4fd4-a3d8-c84f8f75205e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.176385 May 25 14:56:58.702212 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 66/120] 10.222.0.78 () {58 vars in 1274 bytes} [Wed May 25 14:56:58 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912/os-interface => generated 285 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:58.707140 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ddcbe4dd-e08c-455b-80a6-d167f8bba277 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:58.709463 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ddcbe4dd-e08c-455b-80a6-d167f8bba277 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:58.719686 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ddcbe4dd-e08c-455b-80a6-d167f8bba277 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:58.720231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ddcbe4dd-e08c-455b-80a6-d167f8bba277 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:58.720915 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ddcbe4dd-e08c-455b-80a6-d167f8bba277 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:58.721506 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ddcbe4dd-e08c-455b-80a6-d167f8bba277 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:58.763624 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-080e5254-e546-4b6b-b2a5-b2c5de264f2b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "POST /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.079007 May 25 14:56:58.771296 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 55/121] 10.222.0.78 () {60 vars in 1322 bytes} [Wed May 25 14:56:55 2022] POST /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9/os-volume_attachments => generated 194 bytes in 3081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:58.891346 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ddcbe4dd-e08c-455b-80a6-d167f8bba277 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:58.905766 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ddcbe4dd-e08c-455b-80a6-d167f8bba277 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.202255 May 25 14:56:58.906762 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 67/122] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:58 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:59.123765 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-f419ea88-8638-44d1-90f7-1d02578b7d68 req-f77db852-0531-45e3-8f39-80ee84ec0eab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a0babe-e62d-4dd3-8642-7c049a6236a3", "name": "network-vif-plugged", "status": "completed", "tag": "16bf1466-e269-4b11-ae5a-74bda30dcb22"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:59.197093 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-18910b3a-2b61-4571-a09a-591037b6448e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:59.199305 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-18910b3a-2b61-4571-a09a-591037b6448e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:59.222312 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-18910b3a-2b61-4571-a09a-591037b6448e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:59.224279 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-18910b3a-2b61-4571-a09a-591037b6448e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:59.228776 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-18910b3a-2b61-4571-a09a-591037b6448e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:59.228776 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-18910b3a-2b61-4571-a09a-591037b6448e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:59.472665 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-f419ea88-8638-44d1-90f7-1d02578b7d68 req-f77db852-0531-45e3-8f39-80ee84ec0eab service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:59.473103 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-f419ea88-8638-44d1-90f7-1d02578b7d68 req-f77db852-0531-45e3-8f39-80ee84ec0eab service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:59.490884 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-f419ea88-8638-44d1-90f7-1d02578b7d68 req-f77db852-0531-45e3-8f39-80ee84ec0eab service nova] Creating event network-vif-plugged:16bf1466-e269-4b11-ae5a-74bda30dcb22 for instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 on hv-cinder-80382 May 25 14:56:59.502400 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-f419ea88-8638-44d1-90f7-1d02578b7d68 req-f77db852-0531-45e3-8f39-80ee84ec0eab service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.386182 May 25 14:56:59.503349 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 56/123] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:59.656217 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-18910b3a-2b61-4571-a09a-591037b6448e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:59.664156 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-18910b3a-2b61-4571-a09a-591037b6448e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1517 microversion: 2.1 time: 0.481636 May 25 14:56:59.665039 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 68/124] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:59 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1517 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:59.687020 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a04264df-c730-4afa-a4f6-580c87a49386 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:59.688157 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-a04264df-c730-4afa-a4f6-580c87a49386 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:59.695660 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a04264df-c730-4afa-a4f6-580c87a49386 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:59.696374 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a04264df-c730-4afa-a4f6-580c87a49386 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:59.697375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a04264df-c730-4afa-a4f6-580c87a49386 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:59.697981 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a04264df-c730-4afa-a4f6-580c87a49386 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:59.726132 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-a04264df-c730-4afa-a4f6-580c87a49386 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lazy-loading 'flavor' on Instance uuid 95dc2490-acfb-45bb-b4a6-6bc30f8cf983 {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 14:56:59.870491 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-a04264df-c730-4afa-a4f6-580c87a49386 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "POST /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983/action" status: 200 len: 32 microversion: 2.1 time: 0.190044 May 25 14:56:59.872163 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 57/125] 10.222.0.78 () {60 vars in 1277 bytes} [Wed May 25 14:56:59 2022] POST /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 14:56:59.881059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2536723a-5f8e-4fbf-a5be-587b7003e91a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:59.881952 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2536723a-5f8e-4fbf-a5be-587b7003e91a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:59.896004 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2536723a-5f8e-4fbf-a5be-587b7003e91a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:59.896730 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2536723a-5f8e-4fbf-a5be-587b7003e91a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:59.898175 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2536723a-5f8e-4fbf-a5be-587b7003e91a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:59.898857 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2536723a-5f8e-4fbf-a5be-587b7003e91a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:59.934797 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-580a34d6-bd62-4c2b-93da-91101c3bcbf1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:59.936617 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-580a34d6-bd62-4c2b-93da-91101c3bcbf1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:59.945892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-580a34d6-bd62-4c2b-93da-91101c3bcbf1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:59.946602 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-580a34d6-bd62-4c2b-93da-91101c3bcbf1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:59.947583 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-580a34d6-bd62-4c2b-93da-91101c3bcbf1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:59.949277 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-580a34d6-bd62-4c2b-93da-91101c3bcbf1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:00.088679 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2536723a-5f8e-4fbf-a5be-587b7003e91a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:00.101173 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2536723a-5f8e-4fbf-a5be-587b7003e91a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.223824 May 25 14:57:00.105828 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 69/126] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:59 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:00.313225 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-580a34d6-bd62-4c2b-93da-91101c3bcbf1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:00.322656 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-580a34d6-bd62-4c2b-93da-91101c3bcbf1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.402185 May 25 14:57:00.325325 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 58/127] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:56:59 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:00.600090 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-eb47f3cf-1371-45f0-94dd-6a89af4aef8e req-a24eb1fb-0025-4990-bc29-e5a3a322d264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be96576-0efd-4362-8e0d-f74b16ddc912", "tag": "17ca4119-5e7a-4061-9769-ec64b6238082"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:57:00.610553 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-eb47f3cf-1371-45f0-94dd-6a89af4aef8e req-a24eb1fb-0025-4990-bc29-e5a3a322d264 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:00.610963 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-eb47f3cf-1371-45f0-94dd-6a89af4aef8e req-a24eb1fb-0025-4990-bc29-e5a3a322d264 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:00.624692 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-eb47f3cf-1371-45f0-94dd-6a89af4aef8e req-a24eb1fb-0025-4990-bc29-e5a3a322d264 service nova] Creating event network-changed:17ca4119-5e7a-4061-9769-ec64b6238082 for instance 6be96576-0efd-4362-8e0d-f74b16ddc912 on hv-cinder-80382 May 25 14:57:00.630732 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-eb47f3cf-1371-45f0-94dd-6a89af4aef8e req-a24eb1fb-0025-4990-bc29-e5a3a322d264 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034457 May 25 14:57:00.631654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 70/128] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:57:01.129586 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b1ecb3ac-0c01-40b7-8be9-eae734998fc1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:01.130962 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b1ecb3ac-0c01-40b7-8be9-eae734998fc1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:01.133550 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=80 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:01.158979 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b1ecb3ac-0c01-40b7-8be9-eae734998fc1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:01.159605 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b1ecb3ac-0c01-40b7-8be9-eae734998fc1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:01.160785 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b1ecb3ac-0c01-40b7-8be9-eae734998fc1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:01.161679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b1ecb3ac-0c01-40b7-8be9-eae734998fc1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:01.348262 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-9018b05b-f577-45d3-b06a-6f0aaa31113f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:01.349063 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-9018b05b-f577-45d3-b06a-6f0aaa31113f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:01.374074 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9018b05b-f577-45d3-b06a-6f0aaa31113f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:01.376495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9018b05b-f577-45d3-b06a-6f0aaa31113f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:01.378515 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9018b05b-f577-45d3-b06a-6f0aaa31113f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:01.380940 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9018b05b-f577-45d3-b06a-6f0aaa31113f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:01.523098 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b1ecb3ac-0c01-40b7-8be9-eae734998fc1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:01.534915 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b1ecb3ac-0c01-40b7-8be9-eae734998fc1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.415133 May 25 14:57:01.536865 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 59/129] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:01 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:01.669667 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-9018b05b-f577-45d3-b06a-6f0aaa31113f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:01.682132 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-9018b05b-f577-45d3-b06a-6f0aaa31113f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.343323 May 25 14:57:01.693696 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 71/130] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:01 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:57:02.569351 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-9e089d21-2083-465e-aac1-af1ada00b9f9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:02.570217 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-9e089d21-2083-465e-aac1-af1ada00b9f9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:02.597737 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9e089d21-2083-465e-aac1-af1ada00b9f9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:02.598351 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9e089d21-2083-465e-aac1-af1ada00b9f9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:02.599760 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9e089d21-2083-465e-aac1-af1ada00b9f9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:02.600593 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9e089d21-2083-465e-aac1-af1ada00b9f9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:02.701812 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2a6bbfa9-e460-441e-8299-8e491e55a164 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:02.702592 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2a6bbfa9-e460-441e-8299-8e491e55a164 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:02.715142 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2a6bbfa9-e460-441e-8299-8e491e55a164 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:02.715794 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2a6bbfa9-e460-441e-8299-8e491e55a164 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:02.716803 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2a6bbfa9-e460-441e-8299-8e491e55a164 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:02.717231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2a6bbfa9-e460-441e-8299-8e491e55a164 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:02.722420 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=100 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:02.799951 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-9e089d21-2083-465e-aac1-af1ada00b9f9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:02.809563 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-9e089d21-2083-465e-aac1-af1ada00b9f9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.244146 May 25 14:57:02.811437 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 60/131] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:02 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:03.052758 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2a6bbfa9-e460-441e-8299-8e491e55a164 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:03.061999 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2a6bbfa9-e460-441e-8299-8e491e55a164 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.365035 May 25 14:57:03.062603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 72/132] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:02 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:57:03.827327 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-011e3527-8e7d-420a-8c23-bb2383617d0e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:03.827997 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-011e3527-8e7d-420a-8c23-bb2383617d0e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:03.834832 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-011e3527-8e7d-420a-8c23-bb2383617d0e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:03.835446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-011e3527-8e7d-420a-8c23-bb2383617d0e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:03.835842 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-011e3527-8e7d-420a-8c23-bb2383617d0e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:03.836280 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-011e3527-8e7d-420a-8c23-bb2383617d0e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:03.971330 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-011e3527-8e7d-420a-8c23-bb2383617d0e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:03.979891 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-011e3527-8e7d-420a-8c23-bb2383617d0e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.156252 May 25 14:57:03.980645 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 61/133] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:03 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:04.079291 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-6effbfce-c6c5-4015-af16-f90ffcaf54db tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:04.080013 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-6effbfce-c6c5-4015-af16-f90ffcaf54db tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:04.088010 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6effbfce-c6c5-4015-af16-f90ffcaf54db tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:04.088453 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6effbfce-c6c5-4015-af16-f90ffcaf54db tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:04.089764 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6effbfce-c6c5-4015-af16-f90ffcaf54db tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:04.091088 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6effbfce-c6c5-4015-af16-f90ffcaf54db tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:04.234271 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-6effbfce-c6c5-4015-af16-f90ffcaf54db tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:04.241901 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-6effbfce-c6c5-4015-af16-f90ffcaf54db tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.166715 May 25 14:57:04.246727 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 73/134] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:04 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:57:04.996504 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-83ba0f93-2514-4d2a-aca4-98eaec7edea8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:04.997164 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-83ba0f93-2514-4d2a-aca4-98eaec7edea8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:05.003776 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-83ba0f93-2514-4d2a-aca4-98eaec7edea8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:05.004223 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-83ba0f93-2514-4d2a-aca4-98eaec7edea8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:05.004987 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-83ba0f93-2514-4d2a-aca4-98eaec7edea8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:05.005423 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-83ba0f93-2514-4d2a-aca4-98eaec7edea8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:05.137801 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-83ba0f93-2514-4d2a-aca4-98eaec7edea8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:05.145489 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-83ba0f93-2514-4d2a-aca4-98eaec7edea8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.152865 May 25 14:57:05.146060 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 62/135] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:04 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:05.258745 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4b7cb64c-fbb7-4ffb-9009-b04951cc3864 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:05.259364 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4b7cb64c-fbb7-4ffb-9009-b04951cc3864 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:05.266063 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4b7cb64c-fbb7-4ffb-9009-b04951cc3864 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:05.266525 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4b7cb64c-fbb7-4ffb-9009-b04951cc3864 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:05.267507 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4b7cb64c-fbb7-4ffb-9009-b04951cc3864 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:05.267771 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4b7cb64c-fbb7-4ffb-9009-b04951cc3864 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:05.408056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4b7cb64c-fbb7-4ffb-9009-b04951cc3864 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:05.415509 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4b7cb64c-fbb7-4ffb-9009-b04951cc3864 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.160549 May 25 14:57:05.416080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 74/136] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:05 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:06.163410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-3bd7c0c1-3ee8-4a35-9e31-010e4ad914f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:06.164021 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-3bd7c0c1-3ee8-4a35-9e31-010e4ad914f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:06.170677 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3bd7c0c1-3ee8-4a35-9e31-010e4ad914f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:06.171127 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3bd7c0c1-3ee8-4a35-9e31-010e4ad914f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:06.171898 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3bd7c0c1-3ee8-4a35-9e31-010e4ad914f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:06.172334 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3bd7c0c1-3ee8-4a35-9e31-010e4ad914f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:06.303644 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3bd7c0c1-3ee8-4a35-9e31-010e4ad914f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:06.312225 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-3bd7c0c1-3ee8-4a35-9e31-010e4ad914f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.153397 May 25 14:57:06.312800 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 63/137] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:06 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:06.431526 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a2f0ecfb-11c7-4f04-984d-1da30211d88d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:06.432061 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a2f0ecfb-11c7-4f04-984d-1da30211d88d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:06.438739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a2f0ecfb-11c7-4f04-984d-1da30211d88d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:06.439258 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a2f0ecfb-11c7-4f04-984d-1da30211d88d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:06.439945 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a2f0ecfb-11c7-4f04-984d-1da30211d88d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:06.440380 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a2f0ecfb-11c7-4f04-984d-1da30211d88d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:06.568243 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a2f0ecfb-11c7-4f04-984d-1da30211d88d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:06.576269 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a2f0ecfb-11c7-4f04-984d-1da30211d88d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.148765 May 25 14:57:06.576830 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 75/138] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:06 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:07.328453 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-51308ad4-656e-4366-b706-300997c78810 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:07.329216 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-51308ad4-656e-4366-b706-300997c78810 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:07.335774 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-51308ad4-656e-4366-b706-300997c78810 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:07.336220 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-51308ad4-656e-4366-b706-300997c78810 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:07.337121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-51308ad4-656e-4366-b706-300997c78810 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:07.337413 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-51308ad4-656e-4366-b706-300997c78810 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:07.479607 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-51308ad4-656e-4366-b706-300997c78810 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:07.491507 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-51308ad4-656e-4366-b706-300997c78810 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.166655 May 25 14:57:07.492471 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 64/139] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:07 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:07.592716 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2b613316-25c6-4160-966b-fa7ca611592e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:07.593326 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2b613316-25c6-4160-966b-fa7ca611592e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:07.599519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2b613316-25c6-4160-966b-fa7ca611592e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:07.599967 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2b613316-25c6-4160-966b-fa7ca611592e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:07.600796 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2b613316-25c6-4160-966b-fa7ca611592e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:07.601225 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2b613316-25c6-4160-966b-fa7ca611592e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:07.800889 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2b613316-25c6-4160-966b-fa7ca611592e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:07.808340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2b613316-25c6-4160-966b-fa7ca611592e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.219524 May 25 14:57:07.808906 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 76/140] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:07 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:08.515774 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-90df2f71-259d-4d4a-af11-2e708d26d3ad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:08.517171 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-90df2f71-259d-4d4a-af11-2e708d26d3ad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:08.524560 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-90df2f71-259d-4d4a-af11-2e708d26d3ad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:08.525216 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-90df2f71-259d-4d4a-af11-2e708d26d3ad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:08.526747 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-90df2f71-259d-4d4a-af11-2e708d26d3ad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:08.527876 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-90df2f71-259d-4d4a-af11-2e708d26d3ad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:08.677395 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-90df2f71-259d-4d4a-af11-2e708d26d3ad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:08.685514 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-90df2f71-259d-4d4a-af11-2e708d26d3ad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.181451 May 25 14:57:08.686129 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 65/141] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:08 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:08.825611 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-5d325f99-23e4-4c59-85f4-eb4a33a8d1bc tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:08.826509 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-5d325f99-23e4-4c59-85f4-eb4a33a8d1bc tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:08.832692 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5d325f99-23e4-4c59-85f4-eb4a33a8d1bc tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:08.833354 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5d325f99-23e4-4c59-85f4-eb4a33a8d1bc tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:08.834313 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5d325f99-23e4-4c59-85f4-eb4a33a8d1bc tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:08.834692 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5d325f99-23e4-4c59-85f4-eb4a33a8d1bc tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:08.994644 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5d325f99-23e4-4c59-85f4-eb4a33a8d1bc tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:09.002717 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-5d325f99-23e4-4c59-85f4-eb4a33a8d1bc tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.181180 May 25 14:57:09.003294 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 77/142] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:08 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:09.702367 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-40182154-43ac-41e5-bc0a-4c1e581755dc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:09.702988 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-40182154-43ac-41e5-bc0a-4c1e581755dc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:09.709637 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-40182154-43ac-41e5-bc0a-4c1e581755dc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:09.710133 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-40182154-43ac-41e5-bc0a-4c1e581755dc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:09.710897 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-40182154-43ac-41e5-bc0a-4c1e581755dc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:09.711334 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-40182154-43ac-41e5-bc0a-4c1e581755dc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:09.838258 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-40182154-43ac-41e5-bc0a-4c1e581755dc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:09.845707 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-40182154-43ac-41e5-bc0a-4c1e581755dc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.147260 May 25 14:57:09.846305 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 66/143] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:09 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:10.020206 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e8b61604-b889-4ab8-9f3d-605a0df78ee0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:10.020971 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e8b61604-b889-4ab8-9f3d-605a0df78ee0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:10.028318 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e8b61604-b889-4ab8-9f3d-605a0df78ee0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:10.028894 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e8b61604-b889-4ab8-9f3d-605a0df78ee0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:10.029810 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e8b61604-b889-4ab8-9f3d-605a0df78ee0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:10.030287 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e8b61604-b889-4ab8-9f3d-605a0df78ee0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:10.175370 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e8b61604-b889-4ab8-9f3d-605a0df78ee0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:10.183390 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e8b61604-b889-4ab8-9f3d-605a0df78ee0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.167185 May 25 14:57:10.184041 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 78/144] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:10 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:10.862147 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0eb1bd0d-dbae-47d9-bbd1-0b5cf40c0de6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:10.862694 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0eb1bd0d-dbae-47d9-bbd1-0b5cf40c0de6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:10.870337 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0eb1bd0d-dbae-47d9-bbd1-0b5cf40c0de6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:10.870800 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0eb1bd0d-dbae-47d9-bbd1-0b5cf40c0de6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:10.871549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0eb1bd0d-dbae-47d9-bbd1-0b5cf40c0de6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:10.871976 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0eb1bd0d-dbae-47d9-bbd1-0b5cf40c0de6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:11.003471 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-0eb1bd0d-dbae-47d9-bbd1-0b5cf40c0de6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:11.011958 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0eb1bd0d-dbae-47d9-bbd1-0b5cf40c0de6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.153772 May 25 14:57:11.012568 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 67/145] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:10 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:11.200489 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-20cfc2da-b6b7-48a1-8648-460e3260e461 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:11.201107 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-20cfc2da-b6b7-48a1-8648-460e3260e461 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:11.207258 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-20cfc2da-b6b7-48a1-8648-460e3260e461 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:11.207817 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-20cfc2da-b6b7-48a1-8648-460e3260e461 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:11.208578 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-20cfc2da-b6b7-48a1-8648-460e3260e461 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:11.209015 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-20cfc2da-b6b7-48a1-8648-460e3260e461 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:11.530101 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-20cfc2da-b6b7-48a1-8648-460e3260e461 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:11.537629 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-20cfc2da-b6b7-48a1-8648-460e3260e461 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.341030 May 25 14:57:11.538235 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 79/146] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:11 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:12.028818 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-bc297929-8d6a-46ad-b378-06501a624689 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:12.029477 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-bc297929-8d6a-46ad-b378-06501a624689 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:12.036706 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bc297929-8d6a-46ad-b378-06501a624689 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:12.037188 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bc297929-8d6a-46ad-b378-06501a624689 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:12.037977 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bc297929-8d6a-46ad-b378-06501a624689 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:12.038444 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bc297929-8d6a-46ad-b378-06501a624689 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:12.165051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-bc297929-8d6a-46ad-b378-06501a624689 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:12.173064 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-bc297929-8d6a-46ad-b378-06501a624689 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.148340 May 25 14:57:12.173626 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 68/147] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:12 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:12.554152 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-64640e72-fc5f-472c-82fe-d8f26c9f0c7e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:12.554762 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-64640e72-fc5f-472c-82fe-d8f26c9f0c7e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:12.561382 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-64640e72-fc5f-472c-82fe-d8f26c9f0c7e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:12.561833 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-64640e72-fc5f-472c-82fe-d8f26c9f0c7e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:12.562627 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-64640e72-fc5f-472c-82fe-d8f26c9f0c7e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:12.563059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-64640e72-fc5f-472c-82fe-d8f26c9f0c7e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:12.689683 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-64640e72-fc5f-472c-82fe-d8f26c9f0c7e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:12.697108 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-64640e72-fc5f-472c-82fe-d8f26c9f0c7e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1368 microversion: 2.1 time: 0.146894 May 25 14:57:12.698193 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 80/148] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:12 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:13.190266 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-116e0da5-78eb-4486-947f-9824847bde3a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:13.190875 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-116e0da5-78eb-4486-947f-9824847bde3a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:13.197498 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-116e0da5-78eb-4486-947f-9824847bde3a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:13.198644 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-116e0da5-78eb-4486-947f-9824847bde3a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:13.199408 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-116e0da5-78eb-4486-947f-9824847bde3a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:13.199840 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-116e0da5-78eb-4486-947f-9824847bde3a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:13.335542 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-116e0da5-78eb-4486-947f-9824847bde3a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:13.337800 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:13.344594 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-116e0da5-78eb-4486-947f-9824847bde3a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.158202 May 25 14:57:13.345167 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 69/149] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:13 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:13.714024 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-08c0b704-d89d-4384-8cab-824ef1487b6d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:13.714580 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-08c0b704-d89d-4384-8cab-824ef1487b6d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:13.720645 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-08c0b704-d89d-4384-8cab-824ef1487b6d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:13.721258 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-08c0b704-d89d-4384-8cab-824ef1487b6d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:13.721872 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-08c0b704-d89d-4384-8cab-824ef1487b6d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:13.722342 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-08c0b704-d89d-4384-8cab-824ef1487b6d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:13.858235 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-08c0b704-d89d-4384-8cab-824ef1487b6d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:13.865766 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-08c0b704-d89d-4384-8cab-824ef1487b6d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1559 microversion: 2.1 time: 0.155655 May 25 14:57:13.866367 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 81/150] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:13 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:13.882970 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-040d1b77-d6e3-4fd0-9f6a-22390dbd49fd tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:13.883524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-040d1b77-d6e3-4fd0-9f6a-22390dbd49fd tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:13.890127 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-040d1b77-d6e3-4fd0-9f6a-22390dbd49fd tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:13.890575 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-040d1b77-d6e3-4fd0-9f6a-22390dbd49fd tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:13.891332 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-040d1b77-d6e3-4fd0-9f6a-22390dbd49fd tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:13.891764 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-040d1b77-d6e3-4fd0-9f6a-22390dbd49fd tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:13.968093 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-040d1b77-d6e3-4fd0-9f6a-22390dbd49fd tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089381 May 25 14:57:13.968694 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 70/151] 10.222.0.78 () {58 vars in 1274 bytes} [Wed May 25 14:57:13 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:57:14.360591 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-41babc6c-422d-40db-aa22-a3a7b54a3b7e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:14.361504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-41babc6c-422d-40db-aa22-a3a7b54a3b7e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:14.368253 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-41babc6c-422d-40db-aa22-a3a7b54a3b7e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:14.368703 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-41babc6c-422d-40db-aa22-a3a7b54a3b7e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:14.369473 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-41babc6c-422d-40db-aa22-a3a7b54a3b7e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:14.369895 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-41babc6c-422d-40db-aa22-a3a7b54a3b7e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:14.512249 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-41babc6c-422d-40db-aa22-a3a7b54a3b7e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:14.520220 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-41babc6c-422d-40db-aa22-a3a7b54a3b7e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.163421 May 25 14:57:14.520807 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 82/152] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:14 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:57:15.148924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-d77aaccb-c298-41f9-b8ca-d486e3256f2f req-64724373-45d7-47cc-94eb-43dacd3d8164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a0babe-e62d-4dd3-8642-7c049a6236a3", "tag": "16bf1466-e269-4b11-ae5a-74bda30dcb22"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:57:15.160321 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-d77aaccb-c298-41f9-b8ca-d486e3256f2f req-64724373-45d7-47cc-94eb-43dacd3d8164 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:15.160771 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-d77aaccb-c298-41f9-b8ca-d486e3256f2f req-64724373-45d7-47cc-94eb-43dacd3d8164 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:15.173072 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-d77aaccb-c298-41f9-b8ca-d486e3256f2f req-64724373-45d7-47cc-94eb-43dacd3d8164 service nova] Creating event network-changed:16bf1466-e269-4b11-ae5a-74bda30dcb22 for instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 on hv-cinder-80382 May 25 14:57:15.178475 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-d77aaccb-c298-41f9-b8ca-d486e3256f2f req-64724373-45d7-47cc-94eb-43dacd3d8164 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033887 May 25 14:57:15.179083 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 71/153] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:57:15.536806 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-378ce8a0-4eb7-417e-ae74-c187f626162a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:15.537435 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-378ce8a0-4eb7-417e-ae74-c187f626162a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:15.543761 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-378ce8a0-4eb7-417e-ae74-c187f626162a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:15.544203 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-378ce8a0-4eb7-417e-ae74-c187f626162a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:15.544963 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-378ce8a0-4eb7-417e-ae74-c187f626162a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:15.545389 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-378ce8a0-4eb7-417e-ae74-c187f626162a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:15.688238 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-378ce8a0-4eb7-417e-ae74-c187f626162a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:15.696211 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-378ce8a0-4eb7-417e-ae74-c187f626162a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.163249 May 25 14:57:15.697131 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 83/154] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:15 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:16.713513 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-13d0d9be-5418-431b-9439-552f35438f5d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:16.714956 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-13d0d9be-5418-431b-9439-552f35438f5d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:16.722216 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-13d0d9be-5418-431b-9439-552f35438f5d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:16.722724 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-13d0d9be-5418-431b-9439-552f35438f5d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:16.723517 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-13d0d9be-5418-431b-9439-552f35438f5d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:16.724043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-13d0d9be-5418-431b-9439-552f35438f5d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:16.853100 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-13d0d9be-5418-431b-9439-552f35438f5d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:16.861221 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-13d0d9be-5418-431b-9439-552f35438f5d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.152150 May 25 14:57:16.861780 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 72/155] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:16 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:17.877990 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-cfdeb417-b095-4702-b1c2-edd6163214c1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:17.878644 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-cfdeb417-b095-4702-b1c2-edd6163214c1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:17.884685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cfdeb417-b095-4702-b1c2-edd6163214c1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:17.885130 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cfdeb417-b095-4702-b1c2-edd6163214c1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:17.885883 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cfdeb417-b095-4702-b1c2-edd6163214c1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:17.886373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cfdeb417-b095-4702-b1c2-edd6163214c1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:18.020956 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-cfdeb417-b095-4702-b1c2-edd6163214c1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:18.028623 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-cfdeb417-b095-4702-b1c2-edd6163214c1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.154412 May 25 14:57:18.029204 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 84/156] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:17 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:19.044736 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-5c30f901-6989-45ba-beff-c15dae756120 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:19.045344 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-5c30f901-6989-45ba-beff-c15dae756120 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:19.052104 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5c30f901-6989-45ba-beff-c15dae756120 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:19.052600 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5c30f901-6989-45ba-beff-c15dae756120 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:19.053338 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5c30f901-6989-45ba-beff-c15dae756120 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:19.053868 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5c30f901-6989-45ba-beff-c15dae756120 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:19.190374 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-5c30f901-6989-45ba-beff-c15dae756120 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:19.197955 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-5c30f901-6989-45ba-beff-c15dae756120 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.157054 May 25 14:57:19.199161 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 73/157] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:19 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:20.216239 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-453541ad-d337-46a6-bfbf-21241bd09b6b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:20.216887 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-453541ad-d337-46a6-bfbf-21241bd09b6b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:20.223359 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-453541ad-d337-46a6-bfbf-21241bd09b6b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:20.223809 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-453541ad-d337-46a6-bfbf-21241bd09b6b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:20.224581 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-453541ad-d337-46a6-bfbf-21241bd09b6b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:20.225021 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-453541ad-d337-46a6-bfbf-21241bd09b6b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:20.355397 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-453541ad-d337-46a6-bfbf-21241bd09b6b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:20.363041 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-453541ad-d337-46a6-bfbf-21241bd09b6b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.151242 May 25 14:57:20.363552 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 85/158] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:20 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:21.380278 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a7c89f82-63d5-4cff-9c50-81438464f719 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:21.380887 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-a7c89f82-63d5-4cff-9c50-81438464f719 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:21.387542 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a7c89f82-63d5-4cff-9c50-81438464f719 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:21.387988 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a7c89f82-63d5-4cff-9c50-81438464f719 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:21.388753 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a7c89f82-63d5-4cff-9c50-81438464f719 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:21.389188 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a7c89f82-63d5-4cff-9c50-81438464f719 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:21.528899 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-a7c89f82-63d5-4cff-9c50-81438464f719 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:21.536794 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-a7c89f82-63d5-4cff-9c50-81438464f719 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.160558 May 25 14:57:21.537479 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 74/159] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:21 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:22.554273 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-66ed088d-6781-49e1-9ffc-6307b0323f11 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:22.554893 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-66ed088d-6781-49e1-9ffc-6307b0323f11 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:22.561499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-66ed088d-6781-49e1-9ffc-6307b0323f11 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:22.561949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-66ed088d-6781-49e1-9ffc-6307b0323f11 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:22.562738 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-66ed088d-6781-49e1-9ffc-6307b0323f11 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:22.563174 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-66ed088d-6781-49e1-9ffc-6307b0323f11 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:22.717806 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-66ed088d-6781-49e1-9ffc-6307b0323f11 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:22.726115 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-66ed088d-6781-49e1-9ffc-6307b0323f11 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.175698 May 25 14:57:22.726678 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 86/160] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:22 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:23.395263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-971b412a-c009-4fe8-9edc-acef30c0cc7b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:23.395814 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-971b412a-c009-4fe8-9edc-acef30c0cc7b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:23.402954 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-971b412a-c009-4fe8-9edc-acef30c0cc7b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:23.403398 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-971b412a-c009-4fe8-9edc-acef30c0cc7b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:23.404200 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-971b412a-c009-4fe8-9edc-acef30c0cc7b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:23.404629 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-971b412a-c009-4fe8-9edc-acef30c0cc7b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:23.430998 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-971b412a-c009-4fe8-9edc-acef30c0cc7b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Going to try to terminate instance {{(pid=124524) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 14:57:23.520787 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-971b412a-c009-4fe8-9edc-acef30c0cc7b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 204 len: 0 microversion: 2.1 time: 0.130083 May 25 14:57:23.521522 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 75/161] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 14:57:23 2022] DELETE /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 14:57:23.530268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ac8fb8bf-a860-4865-8bee-8d03254a984a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:23.531090 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ac8fb8bf-a860-4865-8bee-8d03254a984a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:23.538521 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ac8fb8bf-a860-4865-8bee-8d03254a984a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:23.538974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ac8fb8bf-a860-4865-8bee-8d03254a984a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:23.539754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ac8fb8bf-a860-4865-8bee-8d03254a984a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:23.540222 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ac8fb8bf-a860-4865-8bee-8d03254a984a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:23.672479 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ac8fb8bf-a860-4865-8bee-8d03254a984a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:23.680412 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ac8fb8bf-a860-4865-8bee-8d03254a984a tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1552 microversion: 2.1 time: 0.154426 May 25 14:57:23.680982 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 87/162] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:23 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:57:23.744806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-23a7503b-3e3d-454e-a044-62e6d46b78cc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:23.746074 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-23a7503b-3e3d-454e-a044-62e6d46b78cc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:23.752279 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-23a7503b-3e3d-454e-a044-62e6d46b78cc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:23.752846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-23a7503b-3e3d-454e-a044-62e6d46b78cc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:23.753476 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-23a7503b-3e3d-454e-a044-62e6d46b78cc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:23.754109 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-23a7503b-3e3d-454e-a044-62e6d46b78cc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:23.895141 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-23a7503b-3e3d-454e-a044-62e6d46b78cc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:23.908758 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-23a7503b-3e3d-454e-a044-62e6d46b78cc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.169236 May 25 14:57:23.909346 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 76/163] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:23 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:24.698293 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-7852e603-1241-432c-8b1f-ca11aaceb0e9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:24.698798 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-7852e603-1241-432c-8b1f-ca11aaceb0e9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:24.704763 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7852e603-1241-432c-8b1f-ca11aaceb0e9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:24.705212 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7852e603-1241-432c-8b1f-ca11aaceb0e9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:24.705975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7852e603-1241-432c-8b1f-ca11aaceb0e9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:24.706428 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7852e603-1241-432c-8b1f-ca11aaceb0e9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:24.836804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-7852e603-1241-432c-8b1f-ca11aaceb0e9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:24.839063 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=100 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:24.846564 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-7852e603-1241-432c-8b1f-ca11aaceb0e9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1552 microversion: 2.1 time: 0.152325 May 25 14:57:24.847132 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 88/164] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:24 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:24.925922 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-866ac2f6-ef44-4ccd-9fc1-91fe420fda98 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:24.926563 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-866ac2f6-ef44-4ccd-9fc1-91fe420fda98 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:24.933664 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-866ac2f6-ef44-4ccd-9fc1-91fe420fda98 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:24.934138 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-866ac2f6-ef44-4ccd-9fc1-91fe420fda98 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:24.934911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-866ac2f6-ef44-4ccd-9fc1-91fe420fda98 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:24.935342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-866ac2f6-ef44-4ccd-9fc1-91fe420fda98 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:25.070969 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-866ac2f6-ef44-4ccd-9fc1-91fe420fda98 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:25.078686 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-866ac2f6-ef44-4ccd-9fc1-91fe420fda98 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.156569 May 25 14:57:25.079290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 77/165] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:24 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:25.864313 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-5f9518df-0199-482b-8578-768eaca3e223 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:25.864925 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-5f9518df-0199-482b-8578-768eaca3e223 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:25.872215 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5f9518df-0199-482b-8578-768eaca3e223 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:25.872827 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5f9518df-0199-482b-8578-768eaca3e223 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:25.873802 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5f9518df-0199-482b-8578-768eaca3e223 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:25.874372 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5f9518df-0199-482b-8578-768eaca3e223 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:26.043604 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5f9518df-0199-482b-8578-768eaca3e223 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:26.054222 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-5f9518df-0199-482b-8578-768eaca3e223 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1552 microversion: 2.1 time: 0.193851 May 25 14:57:26.055339 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 89/166] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:25 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1552 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:26.095851 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-658d71b8-0fb0-44b2-80ed-a93948c7eba5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:26.096454 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-658d71b8-0fb0-44b2-80ed-a93948c7eba5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:26.102665 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-658d71b8-0fb0-44b2-80ed-a93948c7eba5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:26.103201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-658d71b8-0fb0-44b2-80ed-a93948c7eba5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:26.103980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-658d71b8-0fb0-44b2-80ed-a93948c7eba5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:26.104958 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-658d71b8-0fb0-44b2-80ed-a93948c7eba5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:26.264345 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-658d71b8-0fb0-44b2-80ed-a93948c7eba5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:26.276111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-658d71b8-0fb0-44b2-80ed-a93948c7eba5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.183651 May 25 14:57:26.277353 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 78/167] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:26 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:27.071131 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f85a4c5c-e34e-4dbe-ace4-956a17879da6 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:27.071747 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f85a4c5c-e34e-4dbe-ace4-956a17879da6 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:27.079943 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f85a4c5c-e34e-4dbe-ace4-956a17879da6 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:27.080485 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f85a4c5c-e34e-4dbe-ace4-956a17879da6 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:27.081255 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f85a4c5c-e34e-4dbe-ace4-956a17879da6 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:27.081728 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f85a4c5c-e34e-4dbe-ace4-956a17879da6 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:27.239134 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f85a4c5c-e34e-4dbe-ace4-956a17879da6 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:27.250993 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f85a4c5c-e34e-4dbe-ace4-956a17879da6 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1552 microversion: 2.1 time: 0.183673 May 25 14:57:27.252800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 90/168] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:27 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1552 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:27.293294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b55a6581-c452-4304-af8b-9f825966d4a6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:27.294268 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b55a6581-c452-4304-af8b-9f825966d4a6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:27.301348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b55a6581-c452-4304-af8b-9f825966d4a6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:27.301795 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b55a6581-c452-4304-af8b-9f825966d4a6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:27.302653 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b55a6581-c452-4304-af8b-9f825966d4a6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:27.303075 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b55a6581-c452-4304-af8b-9f825966d4a6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:27.452424 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b55a6581-c452-4304-af8b-9f825966d4a6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:27.462152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b55a6581-c452-4304-af8b-9f825966d4a6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.173113 May 25 14:57:27.463024 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 79/169] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:27 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:28.272386 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3b2f3adf-3dc6-46d1-aa09-89fd8f9e96d9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:28.273249 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-3b2f3adf-3dc6-46d1-aa09-89fd8f9e96d9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:28.287640 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3b2f3adf-3dc6-46d1-aa09-89fd8f9e96d9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:28.290725 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3b2f3adf-3dc6-46d1-aa09-89fd8f9e96d9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:28.292327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3b2f3adf-3dc6-46d1-aa09-89fd8f9e96d9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:28.293851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3b2f3adf-3dc6-46d1-aa09-89fd8f9e96d9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:28.428534 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-3b2f3adf-3dc6-46d1-aa09-89fd8f9e96d9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:28.438739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3b2f3adf-3dc6-46d1-aa09-89fd8f9e96d9 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1510 microversion: 2.1 time: 0.172494 May 25 14:57:28.439319 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 91/170] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:28 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:28.484425 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-64488365-f518-49a4-a29a-cafe939740bb tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:28.487110 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-f9492a96-5358-4975-ba8c-c6f1953d07bc req-9e6d9a4f-b237-48d8-95f9-033e4bb9eb2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f7ac9b-d086-4fd8-ad74-1389a710a8b9", "name": "network-vif-deleted", "tag": "f1103ce0-8308-4eee-ba41-b299b65a288b"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:57:28.490741 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-64488365-f518-49a4-a29a-cafe939740bb tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:28.499845 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-f9492a96-5358-4975-ba8c-c6f1953d07bc req-9e6d9a4f-b237-48d8-95f9-033e4bb9eb2b service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:28.500407 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-f9492a96-5358-4975-ba8c-c6f1953d07bc req-9e6d9a4f-b237-48d8-95f9-033e4bb9eb2b service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:28.504107 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-64488365-f518-49a4-a29a-cafe939740bb tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:28.504771 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-64488365-f518-49a4-a29a-cafe939740bb tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:28.505787 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-64488365-f518-49a4-a29a-cafe939740bb tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:28.506410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-64488365-f518-49a4-a29a-cafe939740bb tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:28.515698 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-f9492a96-5358-4975-ba8c-c6f1953d07bc req-9e6d9a4f-b237-48d8-95f9-033e4bb9eb2b service nova] Creating event network-vif-deleted:f1103ce0-8308-4eee-ba41-b299b65a288b for instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 on hv-cinder-80382 May 25 14:57:28.536229 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-f9492a96-5358-4975-ba8c-c6f1953d07bc req-9e6d9a4f-b237-48d8-95f9-033e4bb9eb2b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055014 May 25 14:57:28.537920 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 92/171] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:57:28.734764 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-64488365-f518-49a4-a29a-cafe939740bb tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:28.746869 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-64488365-f518-49a4-a29a-cafe939740bb tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.270730 May 25 14:57:28.748646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 80/172] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:28 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:29.457070 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e056c576-7aa4-4b74-9488-0cc53814d55b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:29.457773 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e056c576-7aa4-4b74-9488-0cc53814d55b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:29.459795 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=54 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:29.469419 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e056c576-7aa4-4b74-9488-0cc53814d55b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:29.470227 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e056c576-7aa4-4b74-9488-0cc53814d55b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:29.471544 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e056c576-7aa4-4b74-9488-0cc53814d55b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:29.472283 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e056c576-7aa4-4b74-9488-0cc53814d55b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:29.542305 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e056c576-7aa4-4b74-9488-0cc53814d55b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd4cec00fe4f0a8dafba7dc16d685e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fab2e6427d486bb1744239b759c415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:29.551835 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e056c576-7aa4-4b74-9488-0cc53814d55b tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 200 len: 1345 microversion: 2.1 time: 0.098518 May 25 14:57:29.552415 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 93/173] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:29 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 1345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:29.765097 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-c97f34e1-acb3-4336-91ba-61d0568423c7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:29.765903 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-c97f34e1-acb3-4336-91ba-61d0568423c7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:29.777928 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c97f34e1-acb3-4336-91ba-61d0568423c7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:29.778433 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c97f34e1-acb3-4336-91ba-61d0568423c7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:29.779013 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c97f34e1-acb3-4336-91ba-61d0568423c7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:29.781333 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c97f34e1-acb3-4336-91ba-61d0568423c7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:29.920165 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-c97f34e1-acb3-4336-91ba-61d0568423c7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:29.928922 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-c97f34e1-acb3-4336-91ba-61d0568423c7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.167751 May 25 14:57:29.929494 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 81/174] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:29 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:30.568909 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f48e8c2e-6a05-4a82-a307-589b57565a4e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:30.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f48e8c2e-6a05-4a82-a307-589b57565a4e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:30.575558 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f48e8c2e-6a05-4a82-a307-589b57565a4e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:30.576005 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f48e8c2e-6a05-4a82-a307-589b57565a4e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:30.576763 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f48e8c2e-6a05-4a82-a307-589b57565a4e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:30.577199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f48e8c2e-6a05-4a82-a307-589b57565a4e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:30.591796 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-f48e8c2e-6a05-4a82-a307-589b57565a4e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] HTTP exception thrown: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f48e8c2e-6a05-4a82-a307-589b57565a4e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Request method failure captured: May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 HTTP/1.1 May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkOEIAD2sqyOT2bRrNGcIg2dViupf8ZIyYCWp4SSSg_QzBHVJvfe3ZNFt64Ar5II9_rwMoanNEEvkUyFIVdoGaP-gPxLwq30HCO9hfDsOwKSOcKIj3cD6cKOXIyWIXTbinXlNT4ekkgU2nh2bjVcIewz1ACCi6IGy6ssi2YbwULH9Ms May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: d3fab2e6427d486bb1744239b759c415 May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-DeleteServersTestJSON-782550536 May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 14:57:30.596519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 14:57:30.597976 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d3fab2e6427d486bb1744239b759c415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d3fab2e6427d486bb1744239b759c415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d3fab2e6427d486bb1744239b759c415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d3fab2e6427d486bb1744239b759c415"}]}] May 25 14:57:30.597976 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-DeleteServersTestJSON-782550536 May 25 14:57:30.597976 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: d3fab2e6427d486bb1744239b759c415 May 25 14:57:30.597976 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-DeleteServersTestJSON-782550536 May 25 14:57:30.597976 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-DeleteServersTestJSON-782550536-project May 25 14:57:30.597976 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 14:57:30.597976 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 14:57:30.597976 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: b3cd4cec00fe4f0a8dafba7dc16d685e May 25 14:57:30.597976 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-DeleteServersTestJSON-782550536-project May 25 14:57:30.597976 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 14:57:30.597976 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:30.597976 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': 'd6f7ac9b-d086-4fd8-ad74-1389a710a8b9'} May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:57:30.598829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:57:30.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:57:30.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 14:57:30.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 14:57:30.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 14:57:30.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 14:57:30.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 14:57:30.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:57:30.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:30.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:30.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:30.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:30.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:30.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:30.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:30.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:57:30.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:57:30.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:30.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:30.601454 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f48e8c2e-6a05-4a82-a307-589b57565a4e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Returning 404 to user: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:57:30.601454 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f48e8c2e-6a05-4a82-a307-589b57565a4e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 404 len: 111 microversion: 2.1 time: 0.033122 May 25 14:57:30.601454 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 94/175] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:30 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 14:57:30.704525 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7e58b00f-5d7d-47a6-acc6-452313c74847 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:30.705448 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7e58b00f-5d7d-47a6-acc6-452313c74847 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:30.711507 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7e58b00f-5d7d-47a6-acc6-452313c74847 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:30.711956 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7e58b00f-5d7d-47a6-acc6-452313c74847 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:30.712716 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7e58b00f-5d7d-47a6-acc6-452313c74847 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:30.713151 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7e58b00f-5d7d-47a6-acc6-452313c74847 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:30.726432 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-7e58b00f-5d7d-47a6-acc6-452313c74847 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] HTTP exception thrown: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7e58b00f-5d7d-47a6-acc6-452313c74847 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Request method failure captured: May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9/os-volume_attachments HTTP/1.1 May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkOEIAD2sqyOT2bRrNGcIg2dViupf8ZIyYCWp4SSSg_QzBHVJvfe3ZNFt64Ar5II9_rwMoanNEEvkUyFIVdoGaP-gPxLwq30HCO9hfDsOwKSOcKIj3cD6cKOXIyWIXTbinXlNT4ekkgU2nh2bjVcIewz1ACCi6IGy6ssi2YbwULH9Ms May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: d3fab2e6427d486bb1744239b759c415 May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-DeleteServersTestJSON-782550536 May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 14:57:30.731294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 14:57:30.732637 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d3fab2e6427d486bb1744239b759c415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d3fab2e6427d486bb1744239b759c415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d3fab2e6427d486bb1744239b759c415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d3fab2e6427d486bb1744239b759c415"}]}] May 25 14:57:30.732637 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-DeleteServersTestJSON-782550536 May 25 14:57:30.732637 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: d3fab2e6427d486bb1744239b759c415 May 25 14:57:30.732637 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-DeleteServersTestJSON-782550536 May 25 14:57:30.732637 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-DeleteServersTestJSON-782550536-project May 25 14:57:30.732637 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 14:57:30.732637 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 14:57:30.732637 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: b3cd4cec00fe4f0a8dafba7dc16d685e May 25 14:57:30.732637 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-DeleteServersTestJSON-782550536-project May 25 14:57:30.732637 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 14:57:30.732637 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:30.732637 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'server_id': 'd6f7ac9b-d086-4fd8-ad74-1389a710a8b9'} May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:57:30.733418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:30.734524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:30.735775 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7e58b00f-5d7d-47a6-acc6-452313c74847 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Returning 404 to user: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:57:30.735775 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7e58b00f-5d7d-47a6-acc6-452313c74847 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032218 May 25 14:57:30.735775 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 82/176] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 14:57:30 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 14:57:30.945980 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-5bf2016f-c696-4cf8-80e6-43a737965e45 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:30.946638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-5bf2016f-c696-4cf8-80e6-43a737965e45 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:30.953273 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5bf2016f-c696-4cf8-80e6-43a737965e45 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:30.953729 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5bf2016f-c696-4cf8-80e6-43a737965e45 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:30.954528 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5bf2016f-c696-4cf8-80e6-43a737965e45 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:30.954955 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5bf2016f-c696-4cf8-80e6-43a737965e45 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:31.098698 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5bf2016f-c696-4cf8-80e6-43a737965e45 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:31.106814 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-5bf2016f-c696-4cf8-80e6-43a737965e45 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.164726 May 25 14:57:31.107375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 95/177] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:30 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:57:32.124316 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2e00b55a-09a2-48f3-9bb3-65e9ee51544c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:32.124941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2e00b55a-09a2-48f3-9bb3-65e9ee51544c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:32.127596 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:32.136034 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2e00b55a-09a2-48f3-9bb3-65e9ee51544c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:32.136407 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2e00b55a-09a2-48f3-9bb3-65e9ee51544c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:32.137212 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2e00b55a-09a2-48f3-9bb3-65e9ee51544c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:32.137647 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2e00b55a-09a2-48f3-9bb3-65e9ee51544c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:32.266192 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-2e00b55a-09a2-48f3-9bb3-65e9ee51544c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:32.273902 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2e00b55a-09a2-48f3-9bb3-65e9ee51544c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.154231 May 25 14:57:32.274484 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 83/178] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:32 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:33.290643 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-dc1bfc16-cc80-4d83-96a9-9b41df82e0c9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:33.291252 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-dc1bfc16-cc80-4d83-96a9-9b41df82e0c9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:33.297323 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dc1bfc16-cc80-4d83-96a9-9b41df82e0c9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:33.297768 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dc1bfc16-cc80-4d83-96a9-9b41df82e0c9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:33.298556 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dc1bfc16-cc80-4d83-96a9-9b41df82e0c9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:33.298985 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dc1bfc16-cc80-4d83-96a9-9b41df82e0c9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:33.425911 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-dc1bfc16-cc80-4d83-96a9-9b41df82e0c9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:33.433953 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-dc1bfc16-cc80-4d83-96a9-9b41df82e0c9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.147151 May 25 14:57:33.434538 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 96/179] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:33 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:34.451119 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7da0b6e1-5824-48f5-aecf-92984871d857 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:34.452022 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7da0b6e1-5824-48f5-aecf-92984871d857 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:34.459091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7da0b6e1-5824-48f5-aecf-92984871d857 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:34.459458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7da0b6e1-5824-48f5-aecf-92984871d857 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:34.460239 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7da0b6e1-5824-48f5-aecf-92984871d857 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:34.460671 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7da0b6e1-5824-48f5-aecf-92984871d857 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:34.596445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7da0b6e1-5824-48f5-aecf-92984871d857 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:34.604969 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7da0b6e1-5824-48f5-aecf-92984871d857 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.158254 May 25 14:57:34.605551 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 84/180] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:34 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:35.628047 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3ee409de-9677-41e7-a0c0-a277ab814557 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:35.628674 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-3ee409de-9677-41e7-a0c0-a277ab814557 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:35.638122 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3ee409de-9677-41e7-a0c0-a277ab814557 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:35.638624 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3ee409de-9677-41e7-a0c0-a277ab814557 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:35.639402 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3ee409de-9677-41e7-a0c0-a277ab814557 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:35.639908 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3ee409de-9677-41e7-a0c0-a277ab814557 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:35.772268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-3ee409de-9677-41e7-a0c0-a277ab814557 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:35.780242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3ee409de-9677-41e7-a0c0-a277ab814557 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.157187 May 25 14:57:35.780806 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 97/181] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:35 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:36.797078 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-5feb6517-7403-4d85-85ef-fedbe4b1bba8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:36.797800 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-5feb6517-7403-4d85-85ef-fedbe4b1bba8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:36.804448 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5feb6517-7403-4d85-85ef-fedbe4b1bba8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:36.804900 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5feb6517-7403-4d85-85ef-fedbe4b1bba8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:36.805664 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5feb6517-7403-4d85-85ef-fedbe4b1bba8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:36.806121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5feb6517-7403-4d85-85ef-fedbe4b1bba8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:36.936836 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-5feb6517-7403-4d85-85ef-fedbe4b1bba8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:36.944538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-5feb6517-7403-4d85-85ef-fedbe4b1bba8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.151255 May 25 14:57:36.945106 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 85/182] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:36 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:57:37.961930 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-dc376121-0f07-4374-b77e-3a46520ca46c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:37.962544 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-dc376121-0f07-4374-b77e-3a46520ca46c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:37.969138 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dc376121-0f07-4374-b77e-3a46520ca46c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:37.969588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dc376121-0f07-4374-b77e-3a46520ca46c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:37.970382 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dc376121-0f07-4374-b77e-3a46520ca46c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:37.970818 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dc376121-0f07-4374-b77e-3a46520ca46c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:38.106390 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-dc376121-0f07-4374-b77e-3a46520ca46c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:38.113865 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-dc376121-0f07-4374-b77e-3a46520ca46c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.155941 May 25 14:57:38.114454 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 98/183] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:37 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:39.130452 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-5b074eb6-304f-4c2a-92b6-3ce3c8832a1f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:39.131055 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-5b074eb6-304f-4c2a-92b6-3ce3c8832a1f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:39.138072 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5b074eb6-304f-4c2a-92b6-3ce3c8832a1f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:39.138516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5b074eb6-304f-4c2a-92b6-3ce3c8832a1f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:39.139264 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5b074eb6-304f-4c2a-92b6-3ce3c8832a1f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:39.139784 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5b074eb6-304f-4c2a-92b6-3ce3c8832a1f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:39.155115 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:39.281130 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-5b074eb6-304f-4c2a-92b6-3ce3c8832a1f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:39.288580 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-5b074eb6-304f-4c2a-92b6-3ce3c8832a1f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.161938 May 25 14:57:39.289141 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 86/184] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:39 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:40.305902 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ae12278b-efa7-4930-8dd9-d3da0c552d79 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:40.306536 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ae12278b-efa7-4930-8dd9-d3da0c552d79 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:40.312635 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ae12278b-efa7-4930-8dd9-d3da0c552d79 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:40.313077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ae12278b-efa7-4930-8dd9-d3da0c552d79 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:40.313831 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ae12278b-efa7-4930-8dd9-d3da0c552d79 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:40.314300 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ae12278b-efa7-4930-8dd9-d3da0c552d79 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:40.446883 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ae12278b-efa7-4930-8dd9-d3da0c552d79 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:40.454888 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ae12278b-efa7-4930-8dd9-d3da0c552d79 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.152821 May 25 14:57:40.455630 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 99/185] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:40 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:41.472139 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-3eff66a6-5049-4b99-995e-26679d877f72 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:41.472831 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-3eff66a6-5049-4b99-995e-26679d877f72 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:41.479865 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3eff66a6-5049-4b99-995e-26679d877f72 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:41.480317 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3eff66a6-5049-4b99-995e-26679d877f72 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:41.481120 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3eff66a6-5049-4b99-995e-26679d877f72 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:41.481557 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3eff66a6-5049-4b99-995e-26679d877f72 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:41.607956 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3eff66a6-5049-4b99-995e-26679d877f72 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:41.615422 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-3eff66a6-5049-4b99-995e-26679d877f72 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.147266 May 25 14:57:41.615985 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 87/186] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:41 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:42.632956 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-916a7bea-279c-4590-a6ee-49d002ed82a5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:42.633560 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-916a7bea-279c-4590-a6ee-49d002ed82a5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:42.640412 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-916a7bea-279c-4590-a6ee-49d002ed82a5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:42.640864 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-916a7bea-279c-4590-a6ee-49d002ed82a5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:42.641629 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-916a7bea-279c-4590-a6ee-49d002ed82a5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:42.642357 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-916a7bea-279c-4590-a6ee-49d002ed82a5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:42.772513 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-916a7bea-279c-4590-a6ee-49d002ed82a5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:42.780809 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-916a7bea-279c-4590-a6ee-49d002ed82a5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.151718 May 25 14:57:42.781397 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 100/187] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:42 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:43.797377 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8a2ce93c-7fce-4a53-85c9-c1114dd92344 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:43.797889 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-8a2ce93c-7fce-4a53-85c9-c1114dd92344 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:43.804502 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8a2ce93c-7fce-4a53-85c9-c1114dd92344 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:43.804955 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8a2ce93c-7fce-4a53-85c9-c1114dd92344 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:43.805730 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8a2ce93c-7fce-4a53-85c9-c1114dd92344 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:43.806202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8a2ce93c-7fce-4a53-85c9-c1114dd92344 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:43.940642 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-8a2ce93c-7fce-4a53-85c9-c1114dd92344 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:43.948739 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-8a2ce93c-7fce-4a53-85c9-c1114dd92344 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.155226 May 25 14:57:43.949313 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 88/188] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:43 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:44.543803 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0c1d2742-b341-4af2-a0a1-297179baff44 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:44.544372 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-0c1d2742-b341-4af2-a0a1-297179baff44 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:44.551042 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0c1d2742-b341-4af2-a0a1-297179baff44 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:44.551503 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0c1d2742-b341-4af2-a0a1-297179baff44 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:44.552301 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0c1d2742-b341-4af2-a0a1-297179baff44 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:44.552716 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0c1d2742-b341-4af2-a0a1-297179baff44 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:44.567897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-0c1d2742-b341-4af2-a0a1-297179baff44 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] HTTP exception thrown: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0c1d2742-b341-4af2-a0a1-297179baff44 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Request method failure captured: May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: DELETE /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 HTTP/1.1 May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkOEIAD2sqyOT2bRrNGcIg2dViupf8ZIyYCWp4SSSg_QzBHVJvfe3ZNFt64Ar5II9_rwMoanNEEvkUyFIVdoGaP-gPxLwq30HCO9hfDsOwKSOcKIj3cD6cKOXIyWIXTbinXlNT4ekkgU2nh2bjVcIewz1ACCi6IGy6ssi2YbwULH9Ms May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: d3fab2e6427d486bb1744239b759c415 May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-DeleteServersTestJSON-782550536 May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 14:57:44.569466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 14:57:44.570781 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d3fab2e6427d486bb1744239b759c415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d3fab2e6427d486bb1744239b759c415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d3fab2e6427d486bb1744239b759c415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d3fab2e6427d486bb1744239b759c415"}]}] May 25 14:57:44.570781 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-DeleteServersTestJSON-782550536 May 25 14:57:44.570781 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: d3fab2e6427d486bb1744239b759c415 May 25 14:57:44.570781 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-DeleteServersTestJSON-782550536 May 25 14:57:44.570781 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-DeleteServersTestJSON-782550536-project May 25 14:57:44.570781 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 14:57:44.570781 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 14:57:44.570781 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: b3cd4cec00fe4f0a8dafba7dc16d685e May 25 14:57:44.570781 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-DeleteServersTestJSON-782550536-project May 25 14:57:44.570781 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 14:57:44.570781 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:44.570781 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': 'd6f7ac9b-d086-4fd8-ad74-1389a710a8b9'} May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:57:44.571707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:44.573685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:44.577757 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0c1d2742-b341-4af2-a0a1-297179baff44 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Returning 404 to user: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:57:44.577757 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-0c1d2742-b341-4af2-a0a1-297179baff44 tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 404 len: 111 microversion: 2.1 time: 0.030963 May 25 14:57:44.581054 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-58a32136-cc16-4995-be85-f1ea954c384e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:44.581694 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-58a32136-cc16-4995-be85-f1ea954c384e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] [instance: d6f7ac9b-d086-4fd8-ad74-1389a710a8b9] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:44.588422 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-58a32136-cc16-4995-be85-f1ea954c384e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:44.588900 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-58a32136-cc16-4995-be85-f1ea954c384e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:44.589752 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-58a32136-cc16-4995-be85-f1ea954c384e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:44.590228 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-58a32136-cc16-4995-be85-f1ea954c384e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:44.592965 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 101/189] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 14:57:44 2022] DELETE /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 14:57:44.606128 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-58a32136-cc16-4995-be85-f1ea954c384e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] HTTP exception thrown: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-58a32136-cc16-4995-be85-f1ea954c384e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Request method failure captured: May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 HTTP/1.1 May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkOEIAD2sqyOT2bRrNGcIg2dViupf8ZIyYCWp4SSSg_QzBHVJvfe3ZNFt64Ar5II9_rwMoanNEEvkUyFIVdoGaP-gPxLwq30HCO9hfDsOwKSOcKIj3cD6cKOXIyWIXTbinXlNT4ekkgU2nh2bjVcIewz1ACCi6IGy6ssi2YbwULH9Ms May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: d3fab2e6427d486bb1744239b759c415 May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-DeleteServersTestJSON-782550536 May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 14:57:44.608263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 14:57:44.609806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d3fab2e6427d486bb1744239b759c415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d3fab2e6427d486bb1744239b759c415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d3fab2e6427d486bb1744239b759c415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d3fab2e6427d486bb1744239b759c415"}]}] May 25 14:57:44.609806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-DeleteServersTestJSON-782550536 May 25 14:57:44.609806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: d3fab2e6427d486bb1744239b759c415 May 25 14:57:44.609806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-DeleteServersTestJSON-782550536 May 25 14:57:44.609806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-DeleteServersTestJSON-782550536-project May 25 14:57:44.609806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 14:57:44.609806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 14:57:44.609806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: b3cd4cec00fe4f0a8dafba7dc16d685e May 25 14:57:44.609806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-DeleteServersTestJSON-782550536-project May 25 14:57:44.609806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 14:57:44.609806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:44.609806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': 'd6f7ac9b-d086-4fd8-ad74-1389a710a8b9'} May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:57:44.610679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:57:44.612152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:57:44.612152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 14:57:44.612152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 14:57:44.612152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 14:57:44.612152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 14:57:44.612152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 14:57:44.612152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:57:44.612152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:44.612152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:44.612152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:44.612152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:44.612152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:44.612152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:44.612152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:44.612152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:57:44.612152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:57:44.612152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. May 25 14:57:44.612152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:44.613257 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-58a32136-cc16-4995-be85-f1ea954c384e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] Returning 404 to user: Instance d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:57:44.613257 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-58a32136-cc16-4995-be85-f1ea954c384e tempest-DeleteServersTestJSON-782550536 tempest-DeleteServersTestJSON-782550536-project] 10.222.0.78 "GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9" status: 404 len: 111 microversion: 2.1 time: 0.032869 May 25 14:57:44.613257 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 89/190] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:44 2022] GET /compute/v2.1/servers/d6f7ac9b-d086-4fd8-ad74-1389a710a8b9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 14:57:44.968078 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-525ad6f3-d55b-4e53-9598-65ded1faba57 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:44.968931 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-525ad6f3-d55b-4e53-9598-65ded1faba57 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:44.976187 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-525ad6f3-d55b-4e53-9598-65ded1faba57 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:44.976637 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-525ad6f3-d55b-4e53-9598-65ded1faba57 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:44.977417 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-525ad6f3-d55b-4e53-9598-65ded1faba57 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:44.977865 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-525ad6f3-d55b-4e53-9598-65ded1faba57 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:45.121658 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-525ad6f3-d55b-4e53-9598-65ded1faba57 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:45.129547 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-525ad6f3-d55b-4e53-9598-65ded1faba57 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.168399 May 25 14:57:45.130138 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 102/191] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:44 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:46.149133 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1dc646cd-9635-4e15-b073-0c50a6241050 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:46.149742 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1dc646cd-9635-4e15-b073-0c50a6241050 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:46.157687 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1dc646cd-9635-4e15-b073-0c50a6241050 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:46.158506 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1dc646cd-9635-4e15-b073-0c50a6241050 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:46.159494 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1dc646cd-9635-4e15-b073-0c50a6241050 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:46.160062 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1dc646cd-9635-4e15-b073-0c50a6241050 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:46.313866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1dc646cd-9635-4e15-b073-0c50a6241050 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:46.321868 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1dc646cd-9635-4e15-b073-0c50a6241050 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.176496 May 25 14:57:46.323189 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 90/192] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:46 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:46.524774 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-bf5ec938-139a-43a7-8df7-4330570fbda8 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Action: 'create', calling method: .version_select at 0x7fb1e02d5d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1815095484"}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:57:46.881179 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-bf5ec938-139a-43a7-8df7-4330570fbda8 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.515437 May 25 14:57:46.882771 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 103/193] 10.222.0.78 () {60 vars in 1154 bytes} [Wed May 25 14:57:46 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 518 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 25 14:57:46.895002 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-75464cbe-fa76-43b1-83f3-9d625bb0af64 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e012a790>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:46.983770 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-75464cbe-fa76-43b1-83f3-9d625bb0af64 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/f2013277-3c9a-4fc6-b1b5-1133b290caa4" status: 200 len: 345 microversion: 2.1 time: 0.093174 May 25 14:57:46.984748 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 91/194] 10.222.0.78 () {58 vars in 1244 bytes} [Wed May 25 14:57:46 2022] GET /compute/v2.1/os-volumes/f2013277-3c9a-4fc6-b1b5-1133b290caa4 => generated 345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:57:47.338789 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2023142f-36a5-41be-a50f-1db22bfbb845 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:47.339418 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2023142f-36a5-41be-a50f-1db22bfbb845 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:47.345655 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2023142f-36a5-41be-a50f-1db22bfbb845 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:47.346130 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2023142f-36a5-41be-a50f-1db22bfbb845 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:47.346884 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2023142f-36a5-41be-a50f-1db22bfbb845 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:47.347309 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2023142f-36a5-41be-a50f-1db22bfbb845 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:47.483694 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2023142f-36a5-41be-a50f-1db22bfbb845 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:47.491342 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2023142f-36a5-41be-a50f-1db22bfbb845 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.156365 May 25 14:57:47.491909 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 104/195] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:47 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:47.997041 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8354b946-76c7-42be-aa94-7d3e61ffd4f1 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e012d940>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:48.047461 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-8354b946-76c7-42be-aa94-7d3e61ffd4f1 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/f2013277-3c9a-4fc6-b1b5-1133b290caa4" status: 200 len: 346 microversion: 2.1 time: 0.054876 May 25 14:57:48.048039 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 92/196] 10.222.0.78 () {58 vars in 1244 bytes} [Wed May 25 14:57:47 2022] GET /compute/v2.1/os-volumes/f2013277-3c9a-4fc6-b1b5-1133b290caa4 => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:57:48.059108 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-da30143e-381b-42fc-925c-455e9b1e57a8 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Action: 'create', calling method: .version_select at 0x7fb1e03293a0>, body: {"snapshot": {"volume_id": "f2013277-3c9a-4fc6-b1b5-1133b290caa4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1848288031"}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:57:48.220094 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-da30143e-381b-42fc-925c-455e9b1e57a8 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.164836 May 25 14:57:48.221138 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 105/197] 10.222.0.78 () {60 vars in 1161 bytes} [Wed May 25 14:57:48 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:57:48.231478 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d9d2b363-01d5-46e3-9ee5-2439d258db68 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e0134af0>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:48.273248 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d9d2b363-01d5-46e3-9ee5-2439d258db68 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15" status: 200 len: 287 microversion: 2.1 time: 0.045856 May 25 14:57:48.273852 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 93/198] 10.222.0.78 () {58 vars in 1250 bytes} [Wed May 25 14:57:48 2022] GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:57:48.284903 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3c18b41a-114d-46e5-baed-d9de2f15f7c1 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e0177dc0>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:48.338762 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3c18b41a-114d-46e5-baed-d9de2f15f7c1 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.058322 May 25 14:57:48.339630 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 106/199] 10.222.0.78 () {58 vars in 1139 bytes} [Wed May 25 14:57:48 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:57:48.351640 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2e142251-25d2-4b3d-9800-6a2b2c537d32 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e012d040>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:48.394317 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2e142251-25d2-4b3d-9800-6a2b2c537d32 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15" status: 200 len: 287 microversion: 2.1 time: 0.046362 May 25 14:57:48.394882 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 94/200] 10.222.0.78 () {58 vars in 1250 bytes} [Wed May 25 14:57:48 2022] GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:57:48.508120 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d7d6a630-4e2b-4031-82e8-2ff888445023 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:48.508887 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d7d6a630-4e2b-4031-82e8-2ff888445023 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:48.521442 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d7d6a630-4e2b-4031-82e8-2ff888445023 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:48.521947 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d7d6a630-4e2b-4031-82e8-2ff888445023 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:48.522746 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d7d6a630-4e2b-4031-82e8-2ff888445023 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:48.523182 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d7d6a630-4e2b-4031-82e8-2ff888445023 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:48.708101 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d7d6a630-4e2b-4031-82e8-2ff888445023 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:48.729730 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d7d6a630-4e2b-4031-82e8-2ff888445023 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.225765 May 25 14:57:48.730369 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 107/201] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:48 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:49.409026 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7cf96c26-e453-4fb5-82bb-9ee0bee2f52a tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e0211700>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:49.440477 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7cf96c26-e453-4fb5-82bb-9ee0bee2f52a tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15" status: 200 len: 287 microversion: 2.1 time: 0.036153 May 25 14:57:49.441038 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 95/202] 10.222.0.78 () {58 vars in 1250 bytes} [Wed May 25 14:57:49 2022] GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:57:49.753106 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ab96b418-900d-404f-a286-5da8801dcae1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:49.753745 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ab96b418-900d-404f-a286-5da8801dcae1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:49.760284 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ab96b418-900d-404f-a286-5da8801dcae1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:49.760829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ab96b418-900d-404f-a286-5da8801dcae1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:49.761527 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ab96b418-900d-404f-a286-5da8801dcae1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:49.761970 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ab96b418-900d-404f-a286-5da8801dcae1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:49.915011 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ab96b418-900d-404f-a286-5da8801dcae1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:49.923673 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ab96b418-900d-404f-a286-5da8801dcae1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.180603 May 25 14:57:49.924269 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 108/203] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:49 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:50.455994 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-efa0d6b3-67b3-49e0-8077-70476e418494 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e0134c10>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:50.511717 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-efa0d6b3-67b3-49e0-8077-70476e418494 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15" status: 200 len: 287 microversion: 2.1 time: 0.062681 May 25 14:57:50.512291 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 96/204] 10.222.0.78 () {58 vars in 1250 bytes} [Wed May 25 14:57:50 2022] GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:57:50.940467 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-81d9eb04-f87b-4b69-87b1-c1dbf12295e6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:50.941069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-81d9eb04-f87b-4b69-87b1-c1dbf12295e6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:50.947644 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-81d9eb04-f87b-4b69-87b1-c1dbf12295e6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:50.948085 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-81d9eb04-f87b-4b69-87b1-c1dbf12295e6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:50.948843 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-81d9eb04-f87b-4b69-87b1-c1dbf12295e6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:50.949273 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-81d9eb04-f87b-4b69-87b1-c1dbf12295e6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:51.089303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-81d9eb04-f87b-4b69-87b1-c1dbf12295e6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:51.101217 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-81d9eb04-f87b-4b69-87b1-c1dbf12295e6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.164404 May 25 14:57:51.101898 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 109/205] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:50 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:57:51.524131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-9e921ff3-ba9d-4c3f-97ff-794bf67bd2d7 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e012dee0>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:51.553896 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-9e921ff3-ba9d-4c3f-97ff-794bf67bd2d7 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15" status: 200 len: 287 microversion: 2.1 time: 0.033957 May 25 14:57:51.554489 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 97/206] 10.222.0.78 () {58 vars in 1250 bytes} [Wed May 25 14:57:51 2022] GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:57:52.117929 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-7b4621ef-1828-4541-86a9-729fa96c3f71 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:52.118595 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-7b4621ef-1828-4541-86a9-729fa96c3f71 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:52.125734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7b4621ef-1828-4541-86a9-729fa96c3f71 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:52.126135 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7b4621ef-1828-4541-86a9-729fa96c3f71 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:52.126907 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7b4621ef-1828-4541-86a9-729fa96c3f71 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:52.127375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7b4621ef-1828-4541-86a9-729fa96c3f71 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:52.142438 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=100 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:52.266418 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-7b4621ef-1828-4541-86a9-729fa96c3f71 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:52.274514 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-7b4621ef-1828-4541-86a9-729fa96c3f71 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.160447 May 25 14:57:52.275637 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 110/207] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:52 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:57:52.566639 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-c49b4cad-55c6-436a-b583-670ec97feed2 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e00e13a0>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:52.636126 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-c49b4cad-55c6-436a-b583-670ec97feed2 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15" status: 200 len: 288 microversion: 2.1 time: 0.073849 May 25 14:57:52.636929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 98/208] 10.222.0.78 () {58 vars in 1250 bytes} [Wed May 25 14:57:52 2022] GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 => generated 288 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:57:52.648061 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a0c52a48-5949-4955-843e-19ea1fc244e6 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e015a5e0>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:52.728281 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a0c52a48-5949-4955-843e-19ea1fc244e6 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "DELETE /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15" status: 202 len: 0 microversion: 2.1 time: 0.084521 May 25 14:57:52.728933 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 111/209] 10.222.0.78 () {58 vars in 1253 bytes} [Wed May 25 14:57:52 2022] DELETE /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 14:57:52.737733 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-dc4faf16-a399-4c95-8433-5c9dd8b9c0f2 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e00e1940>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:52.768918 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-dc4faf16-a399-4c95-8433-5c9dd8b9c0f2 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15" status: 200 len: 287 microversion: 2.1 time: 0.034982 May 25 14:57:52.769512 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 99/210] 10.222.0.78 () {58 vars in 1250 bytes} [Wed May 25 14:57:52 2022] GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:57:53.292456 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-1bd9a0d4-1f0b-4e48-913f-7c4a7c3a8072 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:53.293067 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-1bd9a0d4-1f0b-4e48-913f-7c4a7c3a8072 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:53.299201 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1bd9a0d4-1f0b-4e48-913f-7c4a7c3a8072 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:53.299654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1bd9a0d4-1f0b-4e48-913f-7c4a7c3a8072 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:53.300455 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1bd9a0d4-1f0b-4e48-913f-7c4a7c3a8072 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:53.301047 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1bd9a0d4-1f0b-4e48-913f-7c4a7c3a8072 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:53.436803 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-1bd9a0d4-1f0b-4e48-913f-7c4a7c3a8072 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:53.444618 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-1bd9a0d4-1f0b-4e48-913f-7c4a7c3a8072 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.156618 May 25 14:57:53.445180 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 112/211] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:53 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:53.781128 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-49570760-4b5c-42e1-80dd-77cce84ae423 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e012dca0>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:53.811267 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-49570760-4b5c-42e1-80dd-77cce84ae423 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15" status: 200 len: 287 microversion: 2.1 time: 0.033969 May 25 14:57:53.811829 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 100/212] 10.222.0.78 () {58 vars in 1250 bytes} [Wed May 25 14:57:53 2022] GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:57:54.460729 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-63dbb73d-95f1-4f23-b13e-ffa1a4edcb67 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:54.461372 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-63dbb73d-95f1-4f23-b13e-ffa1a4edcb67 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:54.467470 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-63dbb73d-95f1-4f23-b13e-ffa1a4edcb67 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:54.468267 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-63dbb73d-95f1-4f23-b13e-ffa1a4edcb67 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:54.469042 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-63dbb73d-95f1-4f23-b13e-ffa1a4edcb67 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:54.469480 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-63dbb73d-95f1-4f23-b13e-ffa1a4edcb67 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:54.604249 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-63dbb73d-95f1-4f23-b13e-ffa1a4edcb67 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:54.611660 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-63dbb73d-95f1-4f23-b13e-ffa1a4edcb67 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.154788 May 25 14:57:54.612211 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 113/213] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:54 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:54.823115 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-caf4d99b-f320-4bbc-8baf-5c121afae716 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e00e1af0>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:54.852666 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-caf4d99b-f320-4bbc-8baf-5c121afae716 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15" status: 200 len: 287 microversion: 2.1 time: 0.033760 May 25 14:57:54.853761 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 101/214] 10.222.0.78 () {58 vars in 1250 bytes} [Wed May 25 14:57:54 2022] GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:57:55.629058 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-70f9e16a-47d9-4ed9-9955-e5aa3f9081f9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:55.629662 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-70f9e16a-47d9-4ed9-9955-e5aa3f9081f9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:55.636251 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-70f9e16a-47d9-4ed9-9955-e5aa3f9081f9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:55.636693 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-70f9e16a-47d9-4ed9-9955-e5aa3f9081f9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:55.637453 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-70f9e16a-47d9-4ed9-9955-e5aa3f9081f9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:55.637888 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-70f9e16a-47d9-4ed9-9955-e5aa3f9081f9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:55.771844 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-70f9e16a-47d9-4ed9-9955-e5aa3f9081f9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:55.779543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-70f9e16a-47d9-4ed9-9955-e5aa3f9081f9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.154364 May 25 14:57:55.780099 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 114/215] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:55 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:55.865455 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a042539c-2bf1-4775-b6f9-a353bb287f72 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e00e30d0>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:55.904976 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-a042539c-2bf1-4775-b6f9-a353bb287f72 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15" status: 200 len: 287 microversion: 2.1 time: 0.040992 May 25 14:57:55.904976 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 102/216] 10.222.0.78 () {58 vars in 1250 bytes} [Wed May 25 14:57:55 2022] GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:57:56.797210 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ac3d71b3-626d-495a-92c2-d1c89daa4796 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:56.798127 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ac3d71b3-626d-495a-92c2-d1c89daa4796 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:56.804773 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ac3d71b3-626d-495a-92c2-d1c89daa4796 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:56.805777 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ac3d71b3-626d-495a-92c2-d1c89daa4796 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:56.807331 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ac3d71b3-626d-495a-92c2-d1c89daa4796 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:56.807973 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ac3d71b3-626d-495a-92c2-d1c89daa4796 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:56.910308 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=15 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:56.911516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=23 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:56.916493 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a236ae78-81ba-465a-9a8e-e86a5c284a09 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e0134e50>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:56.951826 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-a236ae78-81ba-465a-9a8e-e86a5c284a09 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] HTTP exception thrown: Snapshot dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 could not be found. May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a236ae78-81ba-465a-9a8e-e86a5c284a09 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Request method failure captured: May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 HTTP/1.1 May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkPq2c4Vs-YrDu1RRM8y4_LJha-wgDgk25elmkVqMWW7Hgyi8siFsFDdq4f_L9BukbhOoG8JRH2FhJdQUzWPcYL3wR1TD8Z8qlrspN_cxAHbnVWXpuxmWdvgMVLt4w_pocGM4r9o3nWf5OqoknlKZXw_CPF5_duWpCumUSP_Yav_ZDU May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 16edf1463a93425298357fc12752c5a9 May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1152079978 May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 14:57:56.955773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 14:57:56.957234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_16edf1463a93425298357fc12752c5a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/16edf1463a93425298357fc12752c5a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/16edf1463a93425298357fc12752c5a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/16edf1463a93425298357fc12752c5a9"}]}] May 25 14:57:56.957234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1152079978 May 25 14:57:56.957234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 16edf1463a93425298357fc12752c5a9 May 25 14:57:56.957234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1152079978 May 25 14:57:56.957234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-VolumesSnapshotsTestJSON-1152079978-project May 25 14:57:56.957234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 14:57:56.957234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 14:57:56.957234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: fda1d04cf14641a2a6ed2152430ae845 May 25 14:57:56.957234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1152079978-project May 25 14:57:56.957234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: May 25 14:57:56.957234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Snapshot dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 could not be found. May 25 14:57:56.957234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': 'dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15'} May 25 14:57:56.957234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:57:56.958179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:56.958179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 25 14:57:56.958179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 25 14:57:56.958179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 25 14:57:56.958179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 25 14:57:56.958179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 25 14:57:56.958179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 25 14:57:56.958179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 14:57:56.958179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 14:57:56.958179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 14:57:56.958179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 14:57:56.958179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:57:56.958179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:57:56.958179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:57:56.958179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:57:56.958179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 could not be found. (HTTP 404) (Request-ID: req-64e6414a-68d9-4b59-967c-4a8f9ca1e5a9) May 25 14:57:56.958179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:56.958179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 14:57:56.963199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 could not be found. May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 25 14:57:56.964419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:57:56.965710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 could not be found. May 25 14:57:56.965710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:56.965710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:56.965710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:56.965710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:56.965710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:56.965710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:56.965710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:57:56.965710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:57:56.965710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 could not be found. May 25 14:57:56.965710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:56.965710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a236ae78-81ba-465a-9a8e-e86a5c284a09 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Returning 404 to user: Snapshot dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:57:56.965710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-a236ae78-81ba-465a-9a8e-e86a5c284a09 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15" status: 404 len: 111 microversion: 2.1 time: 0.048029 May 25 14:57:56.966596 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 103/217] 10.222.0.78 () {58 vars in 1250 bytes} [Wed May 25 14:57:56 2022] GET /compute/v2.1/os-snapshots/dfb6524e-3061-4d1f-9d46-0c5c1dfb9b15 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 14:57:56.967406 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d9a9f7ed-394d-4520-b0d2-ca0f44efc85f tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e00e3940>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:56.970693 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ac3d71b3-626d-495a-92c2-d1c89daa4796 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:56.979883 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ac3d71b3-626d-495a-92c2-d1c89daa4796 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.187451 May 25 14:57:56.989683 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 115/218] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:56 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:57.104063 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d9a9f7ed-394d-4520-b0d2-ca0f44efc85f tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/f2013277-3c9a-4fc6-b1b5-1133b290caa4" status: 202 len: 0 microversion: 2.1 time: 0.140481 May 25 14:57:57.105017 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 104/219] 10.222.0.78 () {58 vars in 1247 bytes} [Wed May 25 14:57:56 2022] DELETE /compute/v2.1/os-volumes/f2013277-3c9a-4fc6-b1b5-1133b290caa4 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 14:57:57.116723 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3303ec4e-af55-4023-bb12-c3d4b5b1509f tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e0171dc0>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:57.194438 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3303ec4e-af55-4023-bb12-c3d4b5b1509f tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/f2013277-3c9a-4fc6-b1b5-1133b290caa4" status: 200 len: 345 microversion: 2.1 time: 0.084932 May 25 14:57:57.195867 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 116/220] 10.222.0.78 () {58 vars in 1244 bytes} [Wed May 25 14:57:57 2022] GET /compute/v2.1/os-volumes/f2013277-3c9a-4fc6-b1b5-1133b290caa4 => generated 345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:57:57.999593 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-73461995-e069-40ea-962f-5720e47bce04 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:58.000328 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-73461995-e069-40ea-962f-5720e47bce04 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:58.006885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-73461995-e069-40ea-962f-5720e47bce04 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:58.007324 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-73461995-e069-40ea-962f-5720e47bce04 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:58.008083 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-73461995-e069-40ea-962f-5720e47bce04 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:58.008504 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-73461995-e069-40ea-962f-5720e47bce04 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:58.139788 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-73461995-e069-40ea-962f-5720e47bce04 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:58.147957 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-73461995-e069-40ea-962f-5720e47bce04 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.154545 May 25 14:57:58.148137 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 105/221] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:57 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:58.208108 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3be91f7d-2d6a-44d4-89bb-4b2fead9a8fd tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e015a700>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:58.234841 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-3be91f7d-2d6a-44d4-89bb-4b2fead9a8fd tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] HTTP exception thrown: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3be91f7d-2d6a-44d4-89bb-4b2fead9a8fd tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Request method failure captured: May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/os-volumes/f2013277-3c9a-4fc6-b1b5-1133b290caa4 HTTP/1.1 May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkPq2c4Vs-YrDu1RRM8y4_LJha-wgDgk25elmkVqMWW7Hgyi8siFsFDdq4f_L9BukbhOoG8JRH2FhJdQUzWPcYL3wR1TD8Z8qlrspN_cxAHbnVWXpuxmWdvgMVLt4w_pocGM4r9o3nWf5OqoknlKZXw_CPF5_duWpCumUSP_Yav_ZDU May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 16edf1463a93425298357fc12752c5a9 May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1152079978 May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 14:57:58.236800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 14:57:58.238279 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_16edf1463a93425298357fc12752c5a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/16edf1463a93425298357fc12752c5a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/16edf1463a93425298357fc12752c5a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/16edf1463a93425298357fc12752c5a9"}]}] May 25 14:57:58.238279 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1152079978 May 25 14:57:58.238279 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 16edf1463a93425298357fc12752c5a9 May 25 14:57:58.238279 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1152079978 May 25 14:57:58.238279 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-VolumesSnapshotsTestJSON-1152079978-project May 25 14:57:58.238279 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 14:57:58.238279 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 14:57:58.238279 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: fda1d04cf14641a2a6ed2152430ae845 May 25 14:57:58.238279 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1152079978-project May 25 14:57:58.238279 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: May 25 14:57:58.238279 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. May 25 14:57:58.238279 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': 'f2013277-3c9a-4fc6-b1b5-1133b290caa4'} May 25 14:57:58.238279 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. (HTTP 404) (Request-ID: req-c0784bd1-c1b3-4915-b136-da74a2dc73e4) May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:58.239199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 14:57:58.240487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 14:57:58.241791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:57:58.243858 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. May 25 14:57:58.243858 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:58.243858 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:58.243858 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:58.243858 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:58.243858 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:58.243858 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:58.243858 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:57:58.243858 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:57:58.243858 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. May 25 14:57:58.243858 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:58.243858 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3be91f7d-2d6a-44d4-89bb-4b2fead9a8fd tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Returning 404 to user: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:57:58.243858 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3be91f7d-2d6a-44d4-89bb-4b2fead9a8fd tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/f2013277-3c9a-4fc6-b1b5-1133b290caa4" status: 404 len: 109 microversion: 2.1 time: 0.034008 May 25 14:57:58.243858 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 117/222] 10.222.0.78 () {58 vars in 1244 bytes} [Wed May 25 14:57:58 2022] GET /compute/v2.1/os-volumes/f2013277-3c9a-4fc6-b1b5-1133b290caa4 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 14:57:58.249290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-45a5da25-2025-4960-9b70-3b143e2a4220 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e00e34c0>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:58.284746 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-45a5da25-2025-4960-9b70-3b143e2a4220 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] HTTP exception thrown: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-45a5da25-2025-4960-9b70-3b143e2a4220 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Request method failure captured: May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: DELETE /compute/v2.1/os-volumes/f2013277-3c9a-4fc6-b1b5-1133b290caa4 HTTP/1.1 May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkPq2c4Vs-YrDu1RRM8y4_LJha-wgDgk25elmkVqMWW7Hgyi8siFsFDdq4f_L9BukbhOoG8JRH2FhJdQUzWPcYL3wR1TD8Z8qlrspN_cxAHbnVWXpuxmWdvgMVLt4w_pocGM4r9o3nWf5OqoknlKZXw_CPF5_duWpCumUSP_Yav_ZDU May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 16edf1463a93425298357fc12752c5a9 May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1152079978 May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 14:57:58.287081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 14:57:58.288487 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_16edf1463a93425298357fc12752c5a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/16edf1463a93425298357fc12752c5a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/16edf1463a93425298357fc12752c5a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/16edf1463a93425298357fc12752c5a9"}]}] May 25 14:57:58.288487 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1152079978 May 25 14:57:58.288487 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 16edf1463a93425298357fc12752c5a9 May 25 14:57:58.288487 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1152079978 May 25 14:57:58.288487 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-VolumesSnapshotsTestJSON-1152079978-project May 25 14:57:58.288487 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 14:57:58.288487 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 14:57:58.288487 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: fda1d04cf14641a2a6ed2152430ae845 May 25 14:57:58.288487 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1152079978-project May 25 14:57:58.288487 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: May 25 14:57:58.288487 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. May 25 14:57:58.288487 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': 'f2013277-3c9a-4fc6-b1b5-1133b290caa4'} May 25 14:57:58.288487 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. (HTTP 404) (Request-ID: req-c3db9315-123a-4deb-b250-f520efd6d0b6) May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:58.289336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 14:57:58.290885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 25 14:57:58.292615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:57:58.294277 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. May 25 14:57:58.294277 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:58.294277 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:58.294277 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:58.294277 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:58.294277 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:58.294277 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:58.294277 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:57:58.294277 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:57:58.294277 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. May 25 14:57:58.294277 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:58.294277 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-45a5da25-2025-4960-9b70-3b143e2a4220 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Returning 404 to user: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:57:58.294277 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-45a5da25-2025-4960-9b70-3b143e2a4220 tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/f2013277-3c9a-4fc6-b1b5-1133b290caa4" status: 404 len: 109 microversion: 2.1 time: 0.044865 May 25 14:57:58.294277 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 106/223] 10.222.0.78 () {58 vars in 1247 bytes} [Wed May 25 14:57:58 2022] DELETE /compute/v2.1/os-volumes/f2013277-3c9a-4fc6-b1b5-1133b290caa4 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 14:57:58.304679 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3fe0753a-7300-4165-9f49-5b6df48ed5fc tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Calling method '.version_select at 0x7fb1e031f550>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:58.330775 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-3fe0753a-7300-4165-9f49-5b6df48ed5fc tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] HTTP exception thrown: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3fe0753a-7300-4165-9f49-5b6df48ed5fc tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Request method failure captured: May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/os-volumes/f2013277-3c9a-4fc6-b1b5-1133b290caa4 HTTP/1.1 May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkPq2c4Vs-YrDu1RRM8y4_LJha-wgDgk25elmkVqMWW7Hgyi8siFsFDdq4f_L9BukbhOoG8JRH2FhJdQUzWPcYL3wR1TD8Z8qlrspN_cxAHbnVWXpuxmWdvgMVLt4w_pocGM4r9o3nWf5OqoknlKZXw_CPF5_duWpCumUSP_Yav_ZDU May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 16edf1463a93425298357fc12752c5a9 May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1152079978 May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 14:57:58.332804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 14:57:58.334245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_16edf1463a93425298357fc12752c5a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/16edf1463a93425298357fc12752c5a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/16edf1463a93425298357fc12752c5a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/16edf1463a93425298357fc12752c5a9"}]}] May 25 14:57:58.334245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1152079978 May 25 14:57:58.334245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 16edf1463a93425298357fc12752c5a9 May 25 14:57:58.334245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1152079978 May 25 14:57:58.334245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-VolumesSnapshotsTestJSON-1152079978-project May 25 14:57:58.334245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 14:57:58.334245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 14:57:58.334245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: fda1d04cf14641a2a6ed2152430ae845 May 25 14:57:58.334245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1152079978-project May 25 14:57:58.334245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: May 25 14:57:58.334245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. May 25 14:57:58.334245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': 'f2013277-3c9a-4fc6-b1b5-1133b290caa4'} May 25 14:57:58.334245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. (HTTP 404) (Request-ID: req-b280666b-afc2-4850-8003-e3ce4d45a1e9) May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:58.335118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 14:57:58.336421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 14:57:58.337724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:57:58.339073 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. May 25 14:57:58.339073 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:58.339073 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:58.339073 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:58.339073 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:58.339073 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:58.339073 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:58.339073 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:57:58.339073 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:57:58.339073 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. May 25 14:57:58.339073 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:58.339073 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3fe0753a-7300-4165-9f49-5b6df48ed5fc tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] Returning 404 to user: Volume f2013277-3c9a-4fc6-b1b5-1133b290caa4 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:57:58.339073 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3fe0753a-7300-4165-9f49-5b6df48ed5fc tempest-VolumesSnapshotsTestJSON-1152079978 tempest-VolumesSnapshotsTestJSON-1152079978-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/f2013277-3c9a-4fc6-b1b5-1133b290caa4" status: 404 len: 109 microversion: 2.1 time: 0.037556 May 25 14:57:58.339073 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 118/224] 10.222.0.78 () {58 vars in 1244 bytes} [Wed May 25 14:57:58 2022] GET /compute/v2.1/os-volumes/f2013277-3c9a-4fc6-b1b5-1133b290caa4 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 14:57:59.165211 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-671512fb-0755-41b2-8df9-393dcda2e25e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:59.166692 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-671512fb-0755-41b2-8df9-393dcda2e25e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:59.177010 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-671512fb-0755-41b2-8df9-393dcda2e25e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:59.177723 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-671512fb-0755-41b2-8df9-393dcda2e25e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:59.178945 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-671512fb-0755-41b2-8df9-393dcda2e25e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:59.179547 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-671512fb-0755-41b2-8df9-393dcda2e25e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:59.339189 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-671512fb-0755-41b2-8df9-393dcda2e25e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:59.348666 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-671512fb-0755-41b2-8df9-393dcda2e25e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.187875 May 25 14:57:59.349236 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 107/225] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:57:59 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:59.786827 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3a3f8e1b-cac0-4e4c-b166-9d9cd2ac6cd7 tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] Action: 'create', calling method: .version_select at 0x7fb1e0171550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-330355554", "metadata": {"Type": "work"}}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3a3f8e1b-cac0-4e4c-b166-9d9cd2ac6cd7 tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] Request method failure captured: May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 121 May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkP3GdtcAArDXdqFf9Cuzsyk5yqZiwCsGQtoLTB4XBVOnPiiBXO8OnuTy7s5VytiEMTjX9e-jog5SQBAfhLvcP1BBzTxpImWmb9DzWJJTxQa430rN7OGhtC9ybaTG7UFFV9km6e3Ik7d_0BmgKFM9zmXiM3onHLLfgJ-m9z4IA7t1zk May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: dfbdd7703e9c40b9ab0f5c5b9712ad6a May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-VolumesNegativeTest-1983435046 May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 14:57:59.792680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 14:57:59.794178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}] May 25 14:57:59.794178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-VolumesNegativeTest-1983435046 May 25 14:57:59.794178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: dfbdd7703e9c40b9ab0f5c5b9712ad6a May 25 14:57:59.794178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-VolumesNegativeTest-1983435046 May 25 14:57:59.794178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-VolumesNegativeTest-1983435046-project May 25 14:57:59.794178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 14:57:59.794178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 14:57:59.794178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: da5e45eaa8c5409592fd9bb2a3fb45e5 May 25 14:57:59.794178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-VolumesNegativeTest-1983435046-project May 25 14:57:59.794178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: May 25 14:57:59.794178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-330355554", "metadata": {"Type": "work"}}} May 25 14:57:59.794178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: May 25 14:57:59.794178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-330355554', 'metadata': {'Type': 'work'}}}} May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise error May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi On instance['volume']: May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi '#$%' May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:57:59.795851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 25 14:57:59.797310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 25 14:57:59.798554 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 25 14:57:59.798554 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.798554 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3a3f8e1b-cac0-4e4c-b166-9d9cd2ac6cd7 tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:57:59.798554 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3a3f8e1b-cac0-4e4c-b166-9d9cd2ac6cd7 tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.123059 May 25 14:57:59.798554 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 119/226] 10.222.0.78 () {60 vars in 1155 bytes} [Wed May 25 14:57:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 14:57:59.803874 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0989b8ae-2346-4338-8116-001a6f517d9b tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] Action: 'create', calling method: .version_select at 0x7fb1e01265e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1507757584", "metadata": {"Type": "work"}}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0989b8ae-2346-4338-8116-001a6f517d9b tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] Request method failure captured: May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 120 May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkP3GdtcAArDXdqFf9Cuzsyk5yqZiwCsGQtoLTB4XBVOnPiiBXO8OnuTy7s5VytiEMTjX9e-jog5SQBAfhLvcP1BBzTxpImWmb9DzWJJTxQa430rN7OGhtC9ybaTG7UFFV9km6e3Ik7d_0BmgKFM9zmXiM3onHLLfgJ-m9z4IA7t1zk May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: dfbdd7703e9c40b9ab0f5c5b9712ad6a May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-VolumesNegativeTest-1983435046 May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 14:57:59.807673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 14:57:59.809121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}] May 25 14:57:59.809121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-VolumesNegativeTest-1983435046 May 25 14:57:59.809121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: dfbdd7703e9c40b9ab0f5c5b9712ad6a May 25 14:57:59.809121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-VolumesNegativeTest-1983435046 May 25 14:57:59.809121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-VolumesNegativeTest-1983435046-project May 25 14:57:59.809121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 14:57:59.809121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 14:57:59.809121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: da5e45eaa8c5409592fd9bb2a3fb45e5 May 25 14:57:59.809121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-VolumesNegativeTest-1983435046-project May 25 14:57:59.809121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: May 25 14:57:59.809121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1507757584", "metadata": {"Type": "work"}}} May 25 14:57:59.809121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: May 25 14:57:59.809121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1507757584', 'metadata': {'Type': 'work'}}}} May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise error May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi On instance['volume']: May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi '0' May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:57:59.809939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 25 14:57:59.811304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 25 14:57:59.812548 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 25 14:57:59.812548 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.812548 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0989b8ae-2346-4338-8116-001a6f517d9b tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:57:59.812548 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0989b8ae-2346-4338-8116-001a6f517d9b tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009003 May 25 14:57:59.812548 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 108/227] 10.222.0.78 () {60 vars in 1155 bytes} [Wed May 25 14:57:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 14:57:59.819124 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-41b3a7d8-8472-4e0a-9084-105fe9ed5e43 tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] Action: 'create', calling method: .version_select at 0x7fb1e02d5d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1900995777", "metadata": {"Type": "work"}}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-41b3a7d8-8472-4e0a-9084-105fe9ed5e43 tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] Request method failure captured: May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 119 May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkP3GdtcAArDXdqFf9Cuzsyk5yqZiwCsGQtoLTB4XBVOnPiiBXO8OnuTy7s5VytiEMTjX9e-jog5SQBAfhLvcP1BBzTxpImWmb9DzWJJTxQa430rN7OGhtC9ybaTG7UFFV9km6e3Ik7d_0BmgKFM9zmXiM3onHLLfgJ-m9z4IA7t1zk May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: dfbdd7703e9c40b9ab0f5c5b9712ad6a May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-VolumesNegativeTest-1983435046 May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 14:57:59.822059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 14:57:59.823228 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}] May 25 14:57:59.823228 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-VolumesNegativeTest-1983435046 May 25 14:57:59.823228 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: dfbdd7703e9c40b9ab0f5c5b9712ad6a May 25 14:57:59.823228 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-VolumesNegativeTest-1983435046 May 25 14:57:59.823228 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-VolumesNegativeTest-1983435046-project May 25 14:57:59.823228 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 14:57:59.823228 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 14:57:59.823228 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: da5e45eaa8c5409592fd9bb2a3fb45e5 May 25 14:57:59.823228 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-VolumesNegativeTest-1983435046-project May 25 14:57:59.823228 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: May 25 14:57:59.823228 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1900995777", "metadata": {"Type": "work"}}} May 25 14:57:59.823228 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: May 25 14:57:59.823228 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1900995777', 'metadata': {'Type': 'work'}}}} May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise error May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi On instance['volume']: May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi '' May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:57:59.823974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 25 14:57:59.825361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 25 14:57:59.826569 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 25 14:57:59.826569 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.826569 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-41b3a7d8-8472-4e0a-9084-105fe9ed5e43 tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:57:59.826569 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-41b3a7d8-8472-4e0a-9084-105fe9ed5e43 tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009496 May 25 14:57:59.826569 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 120/228] 10.222.0.78 () {60 vars in 1155 bytes} [Wed May 25 14:57:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 14:57:59.833235 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6be4c889-4b98-497f-aad1-1983ecfaf3a6 tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] Calling method '.version_select at 0x7fb1e00e3e50>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:59.860914 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-6be4c889-4b98-497f-aad1-1983ecfaf3a6 tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] HTTP exception thrown: Volume tempest-invalid-711442276 could not be found. May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6be4c889-4b98-497f-aad1-1983ecfaf3a6 tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] Request method failure captured: May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-711442276 HTTP/1.1 May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkP3GdtcAArDXdqFf9Cuzsyk5yqZiwCsGQtoLTB4XBVOnPiiBXO8OnuTy7s5VytiEMTjX9e-jog5SQBAfhLvcP1BBzTxpImWmb9DzWJJTxQa430rN7OGhtC9ybaTG7UFFV9km6e3Ik7d_0BmgKFM9zmXiM3onHLLfgJ-m9z4IA7t1zk May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: dfbdd7703e9c40b9ab0f5c5b9712ad6a May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-VolumesNegativeTest-1983435046 May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 14:57:59.863630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 14:57:59.865041 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}] May 25 14:57:59.865041 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-VolumesNegativeTest-1983435046 May 25 14:57:59.865041 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: dfbdd7703e9c40b9ab0f5c5b9712ad6a May 25 14:57:59.865041 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-VolumesNegativeTest-1983435046 May 25 14:57:59.865041 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-VolumesNegativeTest-1983435046-project May 25 14:57:59.865041 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 14:57:59.865041 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 14:57:59.865041 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: da5e45eaa8c5409592fd9bb2a3fb45e5 May 25 14:57:59.865041 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-VolumesNegativeTest-1983435046-project May 25 14:57:59.865041 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: May 25 14:57:59.865041 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Volume tempest-invalid-711442276 could not be found. May 25 14:57:59.865041 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': 'tempest-invalid-711442276'} May 25 14:57:59.865041 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-711442276 could not be found. (HTTP 404) (Request-ID: req-3899cc49-47da-40e8-ad18-cce4b4ffd180) May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:59.865879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 14:57:59.867149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-711442276 could not be found. May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:57:59.868892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-711442276 could not be found. May 25 14:57:59.870148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.870148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:59.870148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.870148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.870148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:59.870148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:59.870148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:57:59.870148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:57:59.870148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-711442276 could not be found. May 25 14:57:59.870148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.870148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6be4c889-4b98-497f-aad1-1983ecfaf3a6 tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] Returning 404 to user: Volume tempest-invalid-711442276 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:57:59.870148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6be4c889-4b98-497f-aad1-1983ecfaf3a6 tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/tempest-invalid-711442276" status: 404 len: 98 microversion: 2.1 time: 0.035590 May 25 14:57:59.870148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 109/229] 10.222.0.78 () {58 vars in 1214 bytes} [Wed May 25 14:57:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-711442276 => generated 98 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 25 14:57:59.875758 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-94fca484-92fd-4a5f-b664-37a1bc12c62f tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004009 May 25 14:57:59.876302 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 121/230] 10.222.0.78 () {58 vars in 1139 bytes} [Wed May 25 14:57:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 25 14:57:59.885175 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d616d92e-8910-434c-a073-b2406d54eb1e tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003779 May 25 14:57:59.885666 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 110/231] 10.222.0.78 () {58 vars in 1136 bytes} [Wed May 25 14:57:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 25 14:57:59.893862 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-bf9a3792-e137-4597-a50c-3d3b4cdae282 tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] Calling method '.version_select at 0x7fb1e02fedc0>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:59.921493 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-bf9a3792-e137-4597-a50c-3d3b4cdae282 tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] HTTP exception thrown: Volume ee7956ea-11ef-45e3-b871-d1c4a6b96294 could not be found. May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-bf9a3792-e137-4597-a50c-3d3b4cdae282 tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] Request method failure captured: May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: DELETE /compute/v2.1/os-volumes/ee7956ea-11ef-45e3-b871-d1c4a6b96294 HTTP/1.1 May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkP3GdtcAArDXdqFf9Cuzsyk5yqZiwCsGQtoLTB4XBVOnPiiBXO8OnuTy7s5VytiEMTjX9e-jog5SQBAfhLvcP1BBzTxpImWmb9DzWJJTxQa430rN7OGhtC9ybaTG7UFFV9km6e3Ik7d_0BmgKFM9zmXiM3onHLLfgJ-m9z4IA7t1zk May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: dfbdd7703e9c40b9ab0f5c5b9712ad6a May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-VolumesNegativeTest-1983435046 May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 14:57:59.923914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 14:57:59.925327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}] May 25 14:57:59.925327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-VolumesNegativeTest-1983435046 May 25 14:57:59.925327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: dfbdd7703e9c40b9ab0f5c5b9712ad6a May 25 14:57:59.925327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-VolumesNegativeTest-1983435046 May 25 14:57:59.925327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-VolumesNegativeTest-1983435046-project May 25 14:57:59.925327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 14:57:59.925327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 14:57:59.925327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: da5e45eaa8c5409592fd9bb2a3fb45e5 May 25 14:57:59.925327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-VolumesNegativeTest-1983435046-project May 25 14:57:59.925327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: May 25 14:57:59.925327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Volume ee7956ea-11ef-45e3-b871-d1c4a6b96294 could not be found. May 25 14:57:59.925327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': 'ee7956ea-11ef-45e3-b871-d1c4a6b96294'} May 25 14:57:59.925327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ee7956ea-11ef-45e3-b871-d1c4a6b96294 could not be found. (HTTP 404) (Request-ID: req-3563b091-448e-408a-8799-a6aba0037691) May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:59.926512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 14:57:59.927799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ee7956ea-11ef-45e3-b871-d1c4a6b96294 could not be found. May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 25 14:57:59.928928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:57:59.930053 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ee7956ea-11ef-45e3-b871-d1c4a6b96294 could not be found. May 25 14:57:59.930053 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.930053 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:59.930053 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.930053 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.930053 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:59.930053 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:59.930053 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:57:59.930053 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:57:59.930053 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ee7956ea-11ef-45e3-b871-d1c4a6b96294 could not be found. May 25 14:57:59.930053 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:57:59.930053 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-bf9a3792-e137-4597-a50c-3d3b4cdae282 tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] Returning 404 to user: Volume ee7956ea-11ef-45e3-b871-d1c4a6b96294 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:57:59.930053 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-bf9a3792-e137-4597-a50c-3d3b4cdae282 tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/ee7956ea-11ef-45e3-b871-d1c4a6b96294" status: 404 len: 109 microversion: 2.1 time: 0.035358 May 25 14:57:59.930053 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 122/232] 10.222.0.78 () {58 vars in 1247 bytes} [Wed May 25 14:57:59 2022] DELETE /compute/v2.1/os-volumes/ee7956ea-11ef-45e3-b871-d1c4a6b96294 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 14:57:59.937085 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-3fc480ab-cfef-4dcd-a8ac-3f88d73e894d tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] Calling method '.version_select at 0x7fb1e00a78b0>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:59.972542 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-3fc480ab-cfef-4dcd-a8ac-3f88d73e894d tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] HTTP exception thrown: Volume 0b63a025-5ca4-464f-be67-0f05692dc950 could not be found. May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-3fc480ab-cfef-4dcd-a8ac-3f88d73e894d tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] Request method failure captured: May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: GET /compute/v2.1/os-volumes/0b63a025-5ca4-464f-be67-0f05692dc950 HTTP/1.1 May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkP3GdtcAArDXdqFf9Cuzsyk5yqZiwCsGQtoLTB4XBVOnPiiBXO8OnuTy7s5VytiEMTjX9e-jog5SQBAfhLvcP1BBzTxpImWmb9DzWJJTxQa430rN7OGhtC9ybaTG7UFFV9km6e3Ik7d_0BmgKFM9zmXiM3onHLLfgJ-m9z4IA7t1zk May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: dfbdd7703e9c40b9ab0f5c5b9712ad6a May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-VolumesNegativeTest-1983435046 May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 14:57:59.975131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 14:57:59.976545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dfbdd7703e9c40b9ab0f5c5b9712ad6a"}]}] May 25 14:57:59.976545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-VolumesNegativeTest-1983435046 May 25 14:57:59.976545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: dfbdd7703e9c40b9ab0f5c5b9712ad6a May 25 14:57:59.976545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-VolumesNegativeTest-1983435046 May 25 14:57:59.976545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-VolumesNegativeTest-1983435046-project May 25 14:57:59.976545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 14:57:59.976545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 14:57:59.976545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: da5e45eaa8c5409592fd9bb2a3fb45e5 May 25 14:57:59.976545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-VolumesNegativeTest-1983435046-project May 25 14:57:59.976545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: May 25 14:57:59.976545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Volume 0b63a025-5ca4-464f-be67-0f05692dc950 could not be found. May 25 14:57:59.976545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': '0b63a025-5ca4-464f-be67-0f05692dc950'} May 25 14:57:59.976545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b63a025-5ca4-464f-be67-0f05692dc950 could not be found. (HTTP 404) (Request-ID: req-06e5ff1d-d227-401d-ad3e-8989a816b9a3) May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:59.977426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 14:57:59.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b63a025-5ca4-464f-be67-0f05692dc950 could not be found. May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 14:57:59.980051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:57:59.981044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b63a025-5ca4-464f-be67-0f05692dc950 could not be found. May 25 14:57:59.981044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.981044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:59.981044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.981044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:59.981044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:59.981044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:59.981044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:57:59.981044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:57:59.981044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b63a025-5ca4-464f-be67-0f05692dc950 could not be found. May 25 14:57:59.981044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:57:59.981044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-3fc480ab-cfef-4dcd-a8ac-3f88d73e894d tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] Returning 404 to user: Volume 0b63a025-5ca4-464f-be67-0f05692dc950 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:57:59.981044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-3fc480ab-cfef-4dcd-a8ac-3f88d73e894d tempest-VolumesNegativeTest-1983435046 tempest-VolumesNegativeTest-1983435046-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/0b63a025-5ca4-464f-be67-0f05692dc950" status: 404 len: 109 microversion: 2.1 time: 0.043718 May 25 14:57:59.981044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 111/233] 10.222.0.78 () {58 vars in 1244 bytes} [Wed May 25 14:57:59 2022] GET /compute/v2.1/os-volumes/0b63a025-5ca4-464f-be67-0f05692dc950 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 14:58:00.367022 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d3ab2ac5-5f09-426d-b8d5-6ba3a0ef7928 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:00.367593 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d3ab2ac5-5f09-426d-b8d5-6ba3a0ef7928 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:00.370827 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=38 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:00.375536 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d3ab2ac5-5f09-426d-b8d5-6ba3a0ef7928 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:00.375994 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d3ab2ac5-5f09-426d-b8d5-6ba3a0ef7928 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:00.376940 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d3ab2ac5-5f09-426d-b8d5-6ba3a0ef7928 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:00.377474 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d3ab2ac5-5f09-426d-b8d5-6ba3a0ef7928 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:00.517227 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d3ab2ac5-5f09-426d-b8d5-6ba3a0ef7928 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:00.532609 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d3ab2ac5-5f09-426d-b8d5-6ba3a0ef7928 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.169503 May 25 14:58:00.533168 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 123/234] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:00 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:01.550549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-c469a9cb-c0e8-4633-80ab-fff20a8c6079 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:01.551683 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-c469a9cb-c0e8-4633-80ab-fff20a8c6079 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:01.557742 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c469a9cb-c0e8-4633-80ab-fff20a8c6079 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:01.558224 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c469a9cb-c0e8-4633-80ab-fff20a8c6079 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:01.558979 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c469a9cb-c0e8-4633-80ab-fff20a8c6079 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:01.559408 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c469a9cb-c0e8-4633-80ab-fff20a8c6079 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:01.713311 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-c469a9cb-c0e8-4633-80ab-fff20a8c6079 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:01.722663 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-c469a9cb-c0e8-4633-80ab-fff20a8c6079 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.176228 May 25 14:58:01.723233 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 112/235] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:01 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:02.742571 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3a973e45-b699-43a8-ae09-9435520a521e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:02.743797 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-3a973e45-b699-43a8-ae09-9435520a521e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:02.750789 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3a973e45-b699-43a8-ae09-9435520a521e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:02.751120 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3a973e45-b699-43a8-ae09-9435520a521e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:02.751908 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3a973e45-b699-43a8-ae09-9435520a521e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:02.752341 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3a973e45-b699-43a8-ae09-9435520a521e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:02.917506 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-3a973e45-b699-43a8-ae09-9435520a521e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:02.929623 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3a973e45-b699-43a8-ae09-9435520a521e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.194101 May 25 14:58:02.930352 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 124/236] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:02 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:03.946889 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-dc0d95f9-f752-46ac-aa1f-b7a552237a96 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:03.947496 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-dc0d95f9-f752-46ac-aa1f-b7a552237a96 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:03.954919 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dc0d95f9-f752-46ac-aa1f-b7a552237a96 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:03.955612 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dc0d95f9-f752-46ac-aa1f-b7a552237a96 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:03.956459 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dc0d95f9-f752-46ac-aa1f-b7a552237a96 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:03.956893 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dc0d95f9-f752-46ac-aa1f-b7a552237a96 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:04.097775 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-dc0d95f9-f752-46ac-aa1f-b7a552237a96 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:04.106087 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-dc0d95f9-f752-46ac-aa1f-b7a552237a96 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.163294 May 25 14:58:04.115099 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 113/237] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:03 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:58:05.123937 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f5002ed6-3e76-4f9f-89f8-54ce62131575 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:05.124617 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f5002ed6-3e76-4f9f-89f8-54ce62131575 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:05.130723 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f5002ed6-3e76-4f9f-89f8-54ce62131575 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:05.131164 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f5002ed6-3e76-4f9f-89f8-54ce62131575 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:05.131926 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f5002ed6-3e76-4f9f-89f8-54ce62131575 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:05.132355 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f5002ed6-3e76-4f9f-89f8-54ce62131575 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:05.285681 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f5002ed6-3e76-4f9f-89f8-54ce62131575 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:05.294441 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f5002ed6-3e76-4f9f-89f8-54ce62131575 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.174749 May 25 14:58:05.295520 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 125/238] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:05 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:06.320868 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b34b35e7-b9f2-4ffc-ac20-55dfb8d8f5c5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:06.334801 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b34b35e7-b9f2-4ffc-ac20-55dfb8d8f5c5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:06.352121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b34b35e7-b9f2-4ffc-ac20-55dfb8d8f5c5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:06.354612 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b34b35e7-b9f2-4ffc-ac20-55dfb8d8f5c5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:06.362485 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b34b35e7-b9f2-4ffc-ac20-55dfb8d8f5c5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:06.363235 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b34b35e7-b9f2-4ffc-ac20-55dfb8d8f5c5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:06.535281 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b34b35e7-b9f2-4ffc-ac20-55dfb8d8f5c5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:06.545321 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b34b35e7-b9f2-4ffc-ac20-55dfb8d8f5c5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.236388 May 25 14:58:06.546235 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 114/239] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:06 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:07.563298 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-35f05571-4f5c-499b-80e8-dec41161bda9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:07.563914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-35f05571-4f5c-499b-80e8-dec41161bda9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:07.573734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-35f05571-4f5c-499b-80e8-dec41161bda9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:07.574225 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-35f05571-4f5c-499b-80e8-dec41161bda9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:07.575001 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-35f05571-4f5c-499b-80e8-dec41161bda9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:07.575617 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-35f05571-4f5c-499b-80e8-dec41161bda9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:07.748839 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-35f05571-4f5c-499b-80e8-dec41161bda9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:07.758682 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-35f05571-4f5c-499b-80e8-dec41161bda9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.199525 May 25 14:58:07.759273 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 126/240] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:07 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:08.776006 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-78ce5ab3-6c90-476f-9a97-30e8a6b8233d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:08.776615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-78ce5ab3-6c90-476f-9a97-30e8a6b8233d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:08.783199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-78ce5ab3-6c90-476f-9a97-30e8a6b8233d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:08.783689 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-78ce5ab3-6c90-476f-9a97-30e8a6b8233d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:08.784462 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-78ce5ab3-6c90-476f-9a97-30e8a6b8233d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:08.784889 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-78ce5ab3-6c90-476f-9a97-30e8a6b8233d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:08.937314 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-78ce5ab3-6c90-476f-9a97-30e8a6b8233d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:08.945578 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-78ce5ab3-6c90-476f-9a97-30e8a6b8233d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.173316 May 25 14:58:08.946217 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 115/241] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:08 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:09.773554 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-786bf7ad-01ec-45ed-9e9e-d85397aa447e tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-349024152", "imageRef": "fbec7c78-0103-4632-9a21-d8e8056f2ce0", "flavorRef": "452"}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:58:09.963658 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-72fbf86c-4a87-43de-bc42-b5a48a01d761 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:09.964500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-72fbf86c-4a87-43de-bc42-b5a48a01d761 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:09.971241 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-72fbf86c-4a87-43de-bc42-b5a48a01d761 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:09.971766 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-72fbf86c-4a87-43de-bc42-b5a48a01d761 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:09.973010 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-72fbf86c-4a87-43de-bc42-b5a48a01d761 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:09.973628 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-72fbf86c-4a87-43de-bc42-b5a48a01d761 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:10.337491 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-72fbf86c-4a87-43de-bc42-b5a48a01d761 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:10.346226 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-72fbf86c-4a87-43de-bc42-b5a48a01d761 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.387119 May 25 14:58:10.346797 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 116/242] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:09 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:58:11.364545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d98c162f-1fab-4006-b12b-b36ec93ba221 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:11.365249 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d98c162f-1fab-4006-b12b-b36ec93ba221 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:11.374198 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d98c162f-1fab-4006-b12b-b36ec93ba221 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:11.375121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d98c162f-1fab-4006-b12b-b36ec93ba221 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:11.376371 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d98c162f-1fab-4006-b12b-b36ec93ba221 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:11.377004 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d98c162f-1fab-4006-b12b-b36ec93ba221 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:11.512347 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d98c162f-1fab-4006-b12b-b36ec93ba221 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:11.520201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d98c162f-1fab-4006-b12b-b36ec93ba221 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.159982 May 25 14:58:11.520803 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 117/243] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:11 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:12.537439 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7b65ee46-1650-4d69-b761-978c54a0332a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:12.538096 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7b65ee46-1650-4d69-b761-978c54a0332a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:12.544846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7b65ee46-1650-4d69-b761-978c54a0332a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:12.545511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7b65ee46-1650-4d69-b761-978c54a0332a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:12.546221 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7b65ee46-1650-4d69-b761-978c54a0332a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:12.546680 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7b65ee46-1650-4d69-b761-978c54a0332a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:12.707609 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7b65ee46-1650-4d69-b761-978c54a0332a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:12.715710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7b65ee46-1650-4d69-b761-978c54a0332a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.182040 May 25 14:58:12.716435 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 118/244] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:12 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:58:12.974757 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.network.neutron [None req-786bf7ad-01ec-45ed-9e9e-d85397aa447e tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] validate_networks() for None {{(pid=124523) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:58:13.481161 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-786bf7ad-01ec-45ed-9e9e-d85397aa447e tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Flavor limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:58:13.481743 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-786bf7ad-01ec-45ed-9e9e-d85397aa447e tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Image limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:58:13.482347 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-786bf7ad-01ec-45ed-9e9e-d85397aa447e tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Flavor pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:58:13.482875 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-786bf7ad-01ec-45ed-9e9e-d85397aa447e tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Image pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:58:13.483564 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-786bf7ad-01ec-45ed-9e9e-d85397aa447e tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:58:13.495831 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-786bf7ad-01ec-45ed-9e9e-d85397aa447e tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:13.496331 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-786bf7ad-01ec-45ed-9e9e-d85397aa447e tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:13.497219 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-786bf7ad-01ec-45ed-9e9e-d85397aa447e tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:13.502110 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-786bf7ad-01ec-45ed-9e9e-d85397aa447e tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:13.517639 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-786bf7ad-01ec-45ed-9e9e-d85397aa447e tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Getting quotas for project 56174c2dc6ce472697756899661f4838. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:58:13.522414 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-786bf7ad-01ec-45ed-9e9e-d85397aa447e tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Getting quotas for user aef8ca7cd35d451ba228a058892f2da4 and project 56174c2dc6ce472697756899661f4838. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:58:13.534389 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-786bf7ad-01ec-45ed-9e9e-d85397aa447e tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Going to run 1 instances... {{(pid=124523) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:58:13.536666 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-786bf7ad-01ec-45ed-9e9e-d85397aa447e tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbec7c78-0103-4632-9a21-d8e8056f2ce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:58:13.581528 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-786bf7ad-01ec-45ed-9e9e-d85397aa447e tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.811793 May 25 14:58:13.587497 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 127/245] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 14:58:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 14:58:13.593358 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-41dd9f5e-ad91-4e8f-870e-639387a7560b tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:13.596545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-41dd9f5e-ad91-4e8f-870e-639387a7560b tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:13.679866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-41dd9f5e-ad91-4e8f-870e-639387a7560b tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:13.702292 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-41dd9f5e-ad91-4e8f-870e-639387a7560b tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1214 microversion: 2.1 time: 0.113351 May 25 14:58:13.712513 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 119/246] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:13 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:58:13.732806 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a998b99b-aa94-46b8-8910-510afc92dc86 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:13.734258 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a998b99b-aa94-46b8-8910-510afc92dc86 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:13.743377 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a998b99b-aa94-46b8-8910-510afc92dc86 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:13.743964 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a998b99b-aa94-46b8-8910-510afc92dc86 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:13.744872 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a998b99b-aa94-46b8-8910-510afc92dc86 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:13.745398 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a998b99b-aa94-46b8-8910-510afc92dc86 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:13.912288 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a998b99b-aa94-46b8-8910-510afc92dc86 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:13.920844 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a998b99b-aa94-46b8-8910-510afc92dc86 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.191971 May 25 14:58:13.921990 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 128/247] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:13 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:14.719597 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-69c360f8-58ce-4ec8-9256-43749fabcb7c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:14.720342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-69c360f8-58ce-4ec8-9256-43749fabcb7c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:14.728075 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-69c360f8-58ce-4ec8-9256-43749fabcb7c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:14.728514 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-69c360f8-58ce-4ec8-9256-43749fabcb7c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:14.730521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-69c360f8-58ce-4ec8-9256-43749fabcb7c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:14.730521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-69c360f8-58ce-4ec8-9256-43749fabcb7c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:14.797910 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-69c360f8-58ce-4ec8-9256-43749fabcb7c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:14.807054 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-69c360f8-58ce-4ec8-9256-43749fabcb7c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1266 microversion: 2.1 time: 0.091187 May 25 14:58:14.807831 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 120/248] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:14 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:14.939794 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d781de85-d93c-4cad-b9ba-3b057755dd99 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:14.940447 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d781de85-d93c-4cad-b9ba-3b057755dd99 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:14.947305 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d781de85-d93c-4cad-b9ba-3b057755dd99 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:14.947684 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d781de85-d93c-4cad-b9ba-3b057755dd99 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:14.948485 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d781de85-d93c-4cad-b9ba-3b057755dd99 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:14.948928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d781de85-d93c-4cad-b9ba-3b057755dd99 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:15.136890 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d781de85-d93c-4cad-b9ba-3b057755dd99 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:15.146628 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d781de85-d93c-4cad-b9ba-3b057755dd99 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.211777 May 25 14:58:15.147304 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 129/249] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:14 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:15.826627 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-c606a243-c3bb-49c0-9e03-72dfa1ee802c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:15.827224 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-c606a243-c3bb-49c0-9e03-72dfa1ee802c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:15.834163 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c606a243-c3bb-49c0-9e03-72dfa1ee802c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:15.834881 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c606a243-c3bb-49c0-9e03-72dfa1ee802c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:15.836823 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c606a243-c3bb-49c0-9e03-72dfa1ee802c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:15.837580 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c606a243-c3bb-49c0-9e03-72dfa1ee802c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:15.903898 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-c606a243-c3bb-49c0-9e03-72dfa1ee802c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:15.911747 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-c606a243-c3bb-49c0-9e03-72dfa1ee802c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1266 microversion: 2.1 time: 0.091004 May 25 14:58:15.912343 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 121/250] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:15 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:16.163875 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-6ef38a27-e664-4ad1-8d76-e652fb6bb490 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:16.164600 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-6ef38a27-e664-4ad1-8d76-e652fb6bb490 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:16.173522 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6ef38a27-e664-4ad1-8d76-e652fb6bb490 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:16.174287 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6ef38a27-e664-4ad1-8d76-e652fb6bb490 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:16.175560 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6ef38a27-e664-4ad1-8d76-e652fb6bb490 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:16.176268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6ef38a27-e664-4ad1-8d76-e652fb6bb490 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:16.321457 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-6ef38a27-e664-4ad1-8d76-e652fb6bb490 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:16.329273 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-6ef38a27-e664-4ad1-8d76-e652fb6bb490 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.169441 May 25 14:58:16.329836 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 130/251] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:16 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:16.928959 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-06a558d9-f9c6-4632-a586-9317f34aaa21 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:16.929569 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-06a558d9-f9c6-4632-a586-9317f34aaa21 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:16.936802 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-06a558d9-f9c6-4632-a586-9317f34aaa21 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:16.936802 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-06a558d9-f9c6-4632-a586-9317f34aaa21 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:16.937436 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-06a558d9-f9c6-4632-a586-9317f34aaa21 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:16.937875 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-06a558d9-f9c6-4632-a586-9317f34aaa21 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:16.999269 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-06a558d9-f9c6-4632-a586-9317f34aaa21 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:17.006957 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-06a558d9-f9c6-4632-a586-9317f34aaa21 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1266 microversion: 2.1 time: 0.082005 May 25 14:58:17.007536 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 122/252] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:16 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:17.349970 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0d913b7e-5a51-42c8-9e66-0c87d3c8a5ba tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:17.350613 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-0d913b7e-5a51-42c8-9e66-0c87d3c8a5ba tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:17.356724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0d913b7e-5a51-42c8-9e66-0c87d3c8a5ba tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:17.357182 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0d913b7e-5a51-42c8-9e66-0c87d3c8a5ba tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:17.357952 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0d913b7e-5a51-42c8-9e66-0c87d3c8a5ba tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:17.358420 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0d913b7e-5a51-42c8-9e66-0c87d3c8a5ba tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:17.498866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-0d913b7e-5a51-42c8-9e66-0c87d3c8a5ba tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:17.506905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-0d913b7e-5a51-42c8-9e66-0c87d3c8a5ba tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.164601 May 25 14:58:17.507466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 131/253] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:17 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:18.023410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-3f2a5964-8ecb-4a1c-96f8-379c26ad9efa tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:18.024048 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-3f2a5964-8ecb-4a1c-96f8-379c26ad9efa tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:18.030981 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3f2a5964-8ecb-4a1c-96f8-379c26ad9efa tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:18.031435 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3f2a5964-8ecb-4a1c-96f8-379c26ad9efa tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:18.032209 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3f2a5964-8ecb-4a1c-96f8-379c26ad9efa tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:18.032896 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3f2a5964-8ecb-4a1c-96f8-379c26ad9efa tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:18.092800 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3f2a5964-8ecb-4a1c-96f8-379c26ad9efa tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:18.100319 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-3f2a5964-8ecb-4a1c-96f8-379c26ad9efa tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1266 microversion: 2.1 time: 0.080813 May 25 14:58:18.100887 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 123/254] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:18 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:18.525031 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-5991d020-1ad9-4252-89ba-931a2bf3d2c0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:18.525635 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-5991d020-1ad9-4252-89ba-931a2bf3d2c0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:18.531771 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5991d020-1ad9-4252-89ba-931a2bf3d2c0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:18.532214 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5991d020-1ad9-4252-89ba-931a2bf3d2c0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:18.532974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5991d020-1ad9-4252-89ba-931a2bf3d2c0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:18.533419 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5991d020-1ad9-4252-89ba-931a2bf3d2c0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:18.665326 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5991d020-1ad9-4252-89ba-931a2bf3d2c0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:18.672742 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-5991d020-1ad9-4252-89ba-931a2bf3d2c0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.152134 May 25 14:58:18.673363 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 132/255] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:18 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:19.117600 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0204c927-b375-4c51-ac92-777614e7fda3 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:19.118253 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0204c927-b375-4c51-ac92-777614e7fda3 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:19.124827 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0204c927-b375-4c51-ac92-777614e7fda3 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:19.125270 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0204c927-b375-4c51-ac92-777614e7fda3 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:19.126060 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0204c927-b375-4c51-ac92-777614e7fda3 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:19.126498 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0204c927-b375-4c51-ac92-777614e7fda3 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:19.192540 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-0204c927-b375-4c51-ac92-777614e7fda3 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:19.200658 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0204c927-b375-4c51-ac92-777614e7fda3 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1266 microversion: 2.1 time: 0.087403 May 25 14:58:19.201219 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 124/256] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:19 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:19.689375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8e85a5b9-ff99-4149-bce7-0c25db68ae21 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:19.690723 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8e85a5b9-ff99-4149-bce7-0c25db68ae21 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:19.697794 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8e85a5b9-ff99-4149-bce7-0c25db68ae21 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:19.698274 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8e85a5b9-ff99-4149-bce7-0c25db68ae21 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:19.699360 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8e85a5b9-ff99-4149-bce7-0c25db68ae21 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:19.700024 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8e85a5b9-ff99-4149-bce7-0c25db68ae21 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:19.874281 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8e85a5b9-ff99-4149-bce7-0c25db68ae21 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:19.883675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8e85a5b9-ff99-4149-bce7-0c25db68ae21 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.198531 May 25 14:58:19.889949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 133/257] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:19 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:20.218430 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-86dda10e-d38f-4c8a-9151-9b5cc3bd0cc8 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:20.219145 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-86dda10e-d38f-4c8a-9151-9b5cc3bd0cc8 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:20.225790 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-86dda10e-d38f-4c8a-9151-9b5cc3bd0cc8 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:20.226267 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-86dda10e-d38f-4c8a-9151-9b5cc3bd0cc8 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:20.227036 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-86dda10e-d38f-4c8a-9151-9b5cc3bd0cc8 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:20.227470 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-86dda10e-d38f-4c8a-9151-9b5cc3bd0cc8 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:20.288565 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-86dda10e-d38f-4c8a-9151-9b5cc3bd0cc8 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:20.296624 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-86dda10e-d38f-4c8a-9151-9b5cc3bd0cc8 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1284 microversion: 2.1 time: 0.082200 May 25 14:58:20.297580 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 125/258] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:20 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1284 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:58:20.900932 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-dde07001-8a8c-475b-b91a-c9aadb3a688f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:20.902281 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-dde07001-8a8c-475b-b91a-c9aadb3a688f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:20.910026 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dde07001-8a8c-475b-b91a-c9aadb3a688f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:20.910476 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dde07001-8a8c-475b-b91a-c9aadb3a688f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:20.911251 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dde07001-8a8c-475b-b91a-c9aadb3a688f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:20.911684 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dde07001-8a8c-475b-b91a-c9aadb3a688f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:21.158997 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-dde07001-8a8c-475b-b91a-c9aadb3a688f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:21.168444 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-dde07001-8a8c-475b-b91a-c9aadb3a688f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1523 microversion: 2.1 time: 0.271510 May 25 14:58:21.169044 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 134/259] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:20 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1523 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:21.314530 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7496fa9b-41e3-47f9-b050-0abd318f6831 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:21.315296 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7496fa9b-41e3-47f9-b050-0abd318f6831 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:21.322147 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7496fa9b-41e3-47f9-b050-0abd318f6831 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:21.322699 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7496fa9b-41e3-47f9-b050-0abd318f6831 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:21.323597 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7496fa9b-41e3-47f9-b050-0abd318f6831 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:21.324207 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7496fa9b-41e3-47f9-b050-0abd318f6831 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:21.474863 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7496fa9b-41e3-47f9-b050-0abd318f6831 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:21.485881 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7496fa9b-41e3-47f9-b050-0abd318f6831 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.175331 May 25 14:58:21.486959 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 126/260] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:21 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:21.948004 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-a7938af0-412a-437a-826e-f87fb0f052b1 req-4f17edb9-313d-4032-b3d1-e6c0abdbc102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca91c55-a0f9-486e-8dd2-0165ec619867", "tag": "464a46c2-9b37-4e50-ba29-ae60e63b45f1"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:58:21.957404 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-a7938af0-412a-437a-826e-f87fb0f052b1 req-4f17edb9-313d-4032-b3d1-e6c0abdbc102 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:21.958674 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-a7938af0-412a-437a-826e-f87fb0f052b1 req-4f17edb9-313d-4032-b3d1-e6c0abdbc102 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:21.972470 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-a7938af0-412a-437a-826e-f87fb0f052b1 req-4f17edb9-313d-4032-b3d1-e6c0abdbc102 service nova] Creating event network-changed:464a46c2-9b37-4e50-ba29-ae60e63b45f1 for instance 7ca91c55-a0f9-486e-8dd2-0165ec619867 on hv-cinder-80382 May 25 14:58:21.978221 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-a7938af0-412a-437a-826e-f87fb0f052b1 req-4f17edb9-313d-4032-b3d1-e6c0abdbc102 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034687 May 25 14:58:21.978839 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 135/261] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:58:22.194732 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-4df62171-ecc2-4c3c-a52f-c369f93e3332 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:22.195964 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-4df62171-ecc2-4c3c-a52f-c369f93e3332 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:22.202518 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4df62171-ecc2-4c3c-a52f-c369f93e3332 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:22.202742 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4df62171-ecc2-4c3c-a52f-c369f93e3332 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:22.203541 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4df62171-ecc2-4c3c-a52f-c369f93e3332 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:22.203981 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4df62171-ecc2-4c3c-a52f-c369f93e3332 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:22.222023 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=100 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:22.333482 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-4df62171-ecc2-4c3c-a52f-c369f93e3332 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:22.341089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-4df62171-ecc2-4c3c-a52f-c369f93e3332 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1503 microversion: 2.1 time: 0.151089 May 25 14:58:22.341667 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 127/262] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:22 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:22.357870 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-eeed0401-3435-4624-8b87-06f1b5488db3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:22.357870 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-eeed0401-3435-4624-8b87-06f1b5488db3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:22.364826 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-eeed0401-3435-4624-8b87-06f1b5488db3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:22.365280 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-eeed0401-3435-4624-8b87-06f1b5488db3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:22.366065 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-eeed0401-3435-4624-8b87-06f1b5488db3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:22.366506 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-eeed0401-3435-4624-8b87-06f1b5488db3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:22.371868 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=98 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:22.505782 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7cd8bcf9-efd7-40b9-b4b6-5768f438e75f tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:22.506806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7cd8bcf9-efd7-40b9-b4b6-5768f438e75f tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:22.512021 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-eeed0401-3435-4624-8b87-06f1b5488db3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:22.513153 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7cd8bcf9-efd7-40b9-b4b6-5768f438e75f tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:22.513599 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7cd8bcf9-efd7-40b9-b4b6-5768f438e75f tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:22.514565 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7cd8bcf9-efd7-40b9-b4b6-5768f438e75f tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:22.515264 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7cd8bcf9-efd7-40b9-b4b6-5768f438e75f tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:22.521139 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-eeed0401-3435-4624-8b87-06f1b5488db3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1516 microversion: 2.1 time: 0.167372 May 25 14:58:22.521924 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 136/263] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:22 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:22.675153 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7cd8bcf9-efd7-40b9-b4b6-5768f438e75f tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:22.683894 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7cd8bcf9-efd7-40b9-b4b6-5768f438e75f tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.183845 May 25 14:58:22.684942 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 128/264] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:22 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:23.700895 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-fe5e39ec-5a0d-4f40-a4fa-9b206d7d4515 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:23.701741 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-fe5e39ec-5a0d-4f40-a4fa-9b206d7d4515 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:23.703621 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=2 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:23.704354 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=6 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:23.710287 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fe5e39ec-5a0d-4f40-a4fa-9b206d7d4515 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:23.711278 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fe5e39ec-5a0d-4f40-a4fa-9b206d7d4515 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:23.712051 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fe5e39ec-5a0d-4f40-a4fa-9b206d7d4515 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:23.712486 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fe5e39ec-5a0d-4f40-a4fa-9b206d7d4515 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:23.846279 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-fe5e39ec-5a0d-4f40-a4fa-9b206d7d4515 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:23.854817 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-fe5e39ec-5a0d-4f40-a4fa-9b206d7d4515 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.157905 May 25 14:58:23.855387 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 137/265] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:23 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:23.937568 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2c1716aa-871f-4f97-8d76-2f01fa8d76fe tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:58:23.938622 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2c1716aa-871f-4f97-8d76-2f01fa8d76fe tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:23.940960 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:23.947061 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2c1716aa-871f-4f97-8d76-2f01fa8d76fe tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:23.947546 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2c1716aa-871f-4f97-8d76-2f01fa8d76fe tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:23.948311 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2c1716aa-871f-4f97-8d76-2f01fa8d76fe tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:23.948741 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2c1716aa-871f-4f97-8d76-2f01fa8d76fe tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:23.972401 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-2c1716aa-871f-4f97-8d76-2f01fa8d76fe tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lazy-loading 'flavor' on Instance uuid 2553a433-8b4b-4f36-b319-50c84e8b3d7c {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 14:58:24.050929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2c1716aa-871f-4f97-8d76-2f01fa8d76fe tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "POST /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c/action" status: 200 len: 32 microversion: 2.1 time: 0.117377 May 25 14:58:24.051526 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 129/266] 10.222.0.78 () {60 vars in 1277 bytes} [Wed May 25 14:58:23 2022] POST /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c/action => generated 32 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 14:58:24.060460 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-bb97ea76-e789-46cd-8755-f17c4ea0e5cd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:24.061251 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-bb97ea76-e789-46cd-8755-f17c4ea0e5cd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:24.067675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bb97ea76-e789-46cd-8755-f17c4ea0e5cd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:24.068123 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bb97ea76-e789-46cd-8755-f17c4ea0e5cd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:24.068898 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bb97ea76-e789-46cd-8755-f17c4ea0e5cd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:24.069355 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bb97ea76-e789-46cd-8755-f17c4ea0e5cd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:24.200091 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-bb97ea76-e789-46cd-8755-f17c4ea0e5cd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:24.207572 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-bb97ea76-e789-46cd-8755-f17c4ea0e5cd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.150910 May 25 14:58:24.208139 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 138/267] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:24 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:24.872687 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-10165cfa-952c-4c95-a62f-9f2daceb7930 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:24.873389 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-10165cfa-952c-4c95-a62f-9f2daceb7930 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:24.879968 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-10165cfa-952c-4c95-a62f-9f2daceb7930 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:24.880423 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-10165cfa-952c-4c95-a62f-9f2daceb7930 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:24.881209 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-10165cfa-952c-4c95-a62f-9f2daceb7930 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:24.881648 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-10165cfa-952c-4c95-a62f-9f2daceb7930 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:25.012894 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-10165cfa-952c-4c95-a62f-9f2daceb7930 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:25.020714 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-10165cfa-952c-4c95-a62f-9f2daceb7930 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.152328 May 25 14:58:25.021279 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 130/268] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:24 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:25.224941 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f9314672-bf77-4fb5-815d-5bc0d9b925f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:25.225448 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f9314672-bf77-4fb5-815d-5bc0d9b925f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:25.232074 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f9314672-bf77-4fb5-815d-5bc0d9b925f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:25.232522 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f9314672-bf77-4fb5-815d-5bc0d9b925f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:25.233280 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f9314672-bf77-4fb5-815d-5bc0d9b925f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:25.233754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f9314672-bf77-4fb5-815d-5bc0d9b925f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:25.369932 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f9314672-bf77-4fb5-815d-5bc0d9b925f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:25.377618 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f9314672-bf77-4fb5-815d-5bc0d9b925f7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.156577 May 25 14:58:25.378216 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 139/269] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:25 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:26.038247 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-c6c97822-88b4-4936-a039-6aa01ddf75f1 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:26.039231 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-c6c97822-88b4-4936-a039-6aa01ddf75f1 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:26.045892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c6c97822-88b4-4936-a039-6aa01ddf75f1 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:26.046377 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c6c97822-88b4-4936-a039-6aa01ddf75f1 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:26.047147 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c6c97822-88b4-4936-a039-6aa01ddf75f1 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:26.047577 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c6c97822-88b4-4936-a039-6aa01ddf75f1 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:26.177061 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-c6c97822-88b4-4936-a039-6aa01ddf75f1 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:26.185058 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-c6c97822-88b4-4936-a039-6aa01ddf75f1 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.150913 May 25 14:58:26.185626 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 131/270] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:26 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:26.395202 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-5907fc12-b243-4e44-9f79-1ee2ebb5c0be tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:26.395800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-5907fc12-b243-4e44-9f79-1ee2ebb5c0be tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:26.404731 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5907fc12-b243-4e44-9f79-1ee2ebb5c0be tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:26.406169 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5907fc12-b243-4e44-9f79-1ee2ebb5c0be tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:26.406953 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5907fc12-b243-4e44-9f79-1ee2ebb5c0be tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:26.407393 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5907fc12-b243-4e44-9f79-1ee2ebb5c0be tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:26.539970 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5907fc12-b243-4e44-9f79-1ee2ebb5c0be tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:26.548208 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-5907fc12-b243-4e44-9f79-1ee2ebb5c0be tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.156827 May 25 14:58:26.548921 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 140/271] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:26 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:27.202676 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-3c656b45-0434-429f-ba1c-260825c0ca61 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:27.203287 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-3c656b45-0434-429f-ba1c-260825c0ca61 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:27.205825 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=47 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:27.211571 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3c656b45-0434-429f-ba1c-260825c0ca61 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:27.212026 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3c656b45-0434-429f-ba1c-260825c0ca61 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:27.212810 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3c656b45-0434-429f-ba1c-260825c0ca61 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:27.213246 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3c656b45-0434-429f-ba1c-260825c0ca61 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:27.347155 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3c656b45-0434-429f-ba1c-260825c0ca61 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:27.354660 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-3c656b45-0434-429f-ba1c-260825c0ca61 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.155928 May 25 14:58:27.355224 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 132/272] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:27 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:27.565373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3100355d-5ceb-420f-bda6-cfe637b0c952 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:27.565992 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-3100355d-5ceb-420f-bda6-cfe637b0c952 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:27.572224 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3100355d-5ceb-420f-bda6-cfe637b0c952 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:27.572676 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3100355d-5ceb-420f-bda6-cfe637b0c952 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:27.573449 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3100355d-5ceb-420f-bda6-cfe637b0c952 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:27.573886 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3100355d-5ceb-420f-bda6-cfe637b0c952 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:27.721520 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-3100355d-5ceb-420f-bda6-cfe637b0c952 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:27.729882 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3100355d-5ceb-420f-bda6-cfe637b0c952 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.168678 May 25 14:58:27.730496 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 141/273] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:27 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:28.374772 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-346a4a34-4206-4d33-9806-8aba52fd6b53 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:28.375577 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-346a4a34-4206-4d33-9806-8aba52fd6b53 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:28.382902 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-346a4a34-4206-4d33-9806-8aba52fd6b53 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:28.382902 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-346a4a34-4206-4d33-9806-8aba52fd6b53 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:28.384615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-346a4a34-4206-4d33-9806-8aba52fd6b53 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:28.385049 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-346a4a34-4206-4d33-9806-8aba52fd6b53 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:28.523009 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-346a4a34-4206-4d33-9806-8aba52fd6b53 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:28.531338 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-346a4a34-4206-4d33-9806-8aba52fd6b53 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.162017 May 25 14:58:28.531915 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 133/274] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:28 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:28.748955 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0701df0f-4e5b-42f3-b3c8-a2b6badf4ea6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:28.750171 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-0701df0f-4e5b-42f3-b3c8-a2b6badf4ea6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:28.757438 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0701df0f-4e5b-42f3-b3c8-a2b6badf4ea6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:28.757952 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0701df0f-4e5b-42f3-b3c8-a2b6badf4ea6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:28.759686 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0701df0f-4e5b-42f3-b3c8-a2b6badf4ea6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:28.760143 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0701df0f-4e5b-42f3-b3c8-a2b6badf4ea6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:28.902479 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-0701df0f-4e5b-42f3-b3c8-a2b6badf4ea6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:28.913665 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-0701df0f-4e5b-42f3-b3c8-a2b6badf4ea6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.170425 May 25 14:58:28.914803 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 142/275] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:28 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:29.548067 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6502fc05-5007-4b7e-b1e3-52c67dc6a194 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:29.548665 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6502fc05-5007-4b7e-b1e3-52c67dc6a194 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:29.555215 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6502fc05-5007-4b7e-b1e3-52c67dc6a194 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:29.555657 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6502fc05-5007-4b7e-b1e3-52c67dc6a194 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:29.556416 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6502fc05-5007-4b7e-b1e3-52c67dc6a194 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:29.556846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6502fc05-5007-4b7e-b1e3-52c67dc6a194 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:29.688688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6502fc05-5007-4b7e-b1e3-52c67dc6a194 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:29.696115 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6502fc05-5007-4b7e-b1e3-52c67dc6a194 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.151964 May 25 14:58:29.696676 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 134/276] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:29 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:29.930332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b3a7ab0f-2381-43d7-81f6-194652273c4e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:29.931009 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-b3a7ab0f-2381-43d7-81f6-194652273c4e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:29.937184 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b3a7ab0f-2381-43d7-81f6-194652273c4e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:29.937636 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b3a7ab0f-2381-43d7-81f6-194652273c4e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:29.938540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b3a7ab0f-2381-43d7-81f6-194652273c4e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:29.938982 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b3a7ab0f-2381-43d7-81f6-194652273c4e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:30.069869 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-b3a7ab0f-2381-43d7-81f6-194652273c4e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:30.077825 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-b3a7ab0f-2381-43d7-81f6-194652273c4e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.151482 May 25 14:58:30.078414 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 143/277] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:29 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:30.712772 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-93c1fbaf-ab47-4be4-b922-34d5fd46b794 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:30.713306 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-93c1fbaf-ab47-4be4-b922-34d5fd46b794 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:30.719939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-93c1fbaf-ab47-4be4-b922-34d5fd46b794 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:30.720382 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-93c1fbaf-ab47-4be4-b922-34d5fd46b794 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:30.721200 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-93c1fbaf-ab47-4be4-b922-34d5fd46b794 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:30.721628 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-93c1fbaf-ab47-4be4-b922-34d5fd46b794 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:30.852663 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-93c1fbaf-ab47-4be4-b922-34d5fd46b794 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:30.861490 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-93c1fbaf-ab47-4be4-b922-34d5fd46b794 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.152535 May 25 14:58:30.862380 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 135/278] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:30 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:31.095772 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-358cbe88-319c-4a4e-a977-1aa10fc75dad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:31.096413 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-358cbe88-319c-4a4e-a977-1aa10fc75dad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:31.098328 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:31.104188 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-358cbe88-319c-4a4e-a977-1aa10fc75dad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:31.104637 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-358cbe88-319c-4a4e-a977-1aa10fc75dad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:31.105401 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-358cbe88-319c-4a4e-a977-1aa10fc75dad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:31.105841 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-358cbe88-319c-4a4e-a977-1aa10fc75dad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:31.504240 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-358cbe88-319c-4a4e-a977-1aa10fc75dad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:31.513178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-358cbe88-319c-4a4e-a977-1aa10fc75dad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.421271 May 25 14:58:31.513766 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 144/279] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:31 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:31.878316 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6fd684a0-6d0d-45b4-b921-e7e4a0e199ed tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:31.879027 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6fd684a0-6d0d-45b4-b921-e7e4a0e199ed tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:31.886273 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6fd684a0-6d0d-45b4-b921-e7e4a0e199ed tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:31.886724 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6fd684a0-6d0d-45b4-b921-e7e4a0e199ed tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:31.887491 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6fd684a0-6d0d-45b4-b921-e7e4a0e199ed tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:31.887925 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6fd684a0-6d0d-45b4-b921-e7e4a0e199ed tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:32.023695 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6fd684a0-6d0d-45b4-b921-e7e4a0e199ed tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:32.031230 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6fd684a0-6d0d-45b4-b921-e7e4a0e199ed tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.156807 May 25 14:58:32.031799 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 136/280] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:31 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:32.530555 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d1f1383e-b58b-416b-aecd-b661635bc25c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:32.531872 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d1f1383e-b58b-416b-aecd-b661635bc25c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:32.537339 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d1f1383e-b58b-416b-aecd-b661635bc25c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:32.537783 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d1f1383e-b58b-416b-aecd-b661635bc25c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:32.538563 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d1f1383e-b58b-416b-aecd-b661635bc25c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:32.538998 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d1f1383e-b58b-416b-aecd-b661635bc25c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:32.675213 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d1f1383e-b58b-416b-aecd-b661635bc25c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:32.687975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d1f1383e-b58b-416b-aecd-b661635bc25c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.161287 May 25 14:58:32.688550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 145/281] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:32 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:33.050934 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b3f47dcf-6790-4f43-9338-debb29eaeb54 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:33.051576 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b3f47dcf-6790-4f43-9338-debb29eaeb54 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:33.058723 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b3f47dcf-6790-4f43-9338-debb29eaeb54 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:33.059172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b3f47dcf-6790-4f43-9338-debb29eaeb54 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:33.059941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b3f47dcf-6790-4f43-9338-debb29eaeb54 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:33.060384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b3f47dcf-6790-4f43-9338-debb29eaeb54 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:33.190341 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b3f47dcf-6790-4f43-9338-debb29eaeb54 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:33.198545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b3f47dcf-6790-4f43-9338-debb29eaeb54 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.151702 May 25 14:58:33.199108 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 137/282] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:33 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:33.704622 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-9b3c852a-491d-4ef6-b2fa-32a152fe8a02 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:33.705330 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-9b3c852a-491d-4ef6-b2fa-32a152fe8a02 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:33.711387 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9b3c852a-491d-4ef6-b2fa-32a152fe8a02 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:33.711840 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9b3c852a-491d-4ef6-b2fa-32a152fe8a02 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:33.712601 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9b3c852a-491d-4ef6-b2fa-32a152fe8a02 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:33.713038 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9b3c852a-491d-4ef6-b2fa-32a152fe8a02 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:33.842696 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-9b3c852a-491d-4ef6-b2fa-32a152fe8a02 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:33.850167 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-9b3c852a-491d-4ef6-b2fa-32a152fe8a02 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.149409 May 25 14:58:33.850770 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 146/283] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:33 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:34.215452 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-03bcae49-0d68-4272-91a0-59290d47727c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:34.216141 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-03bcae49-0d68-4272-91a0-59290d47727c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:34.222728 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-03bcae49-0d68-4272-91a0-59290d47727c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:34.223163 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-03bcae49-0d68-4272-91a0-59290d47727c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:34.223922 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-03bcae49-0d68-4272-91a0-59290d47727c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:34.224352 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-03bcae49-0d68-4272-91a0-59290d47727c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:34.353755 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-03bcae49-0d68-4272-91a0-59290d47727c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:34.361306 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-03bcae49-0d68-4272-91a0-59290d47727c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.150174 May 25 14:58:34.361866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 138/284] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:34 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:34.867428 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f138a344-7cc2-4fde-bec0-e45db3f51a74 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:34.867974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f138a344-7cc2-4fde-bec0-e45db3f51a74 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:34.873995 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f138a344-7cc2-4fde-bec0-e45db3f51a74 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:34.874476 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f138a344-7cc2-4fde-bec0-e45db3f51a74 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:34.875233 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f138a344-7cc2-4fde-bec0-e45db3f51a74 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:34.875668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f138a344-7cc2-4fde-bec0-e45db3f51a74 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:35.015694 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f138a344-7cc2-4fde-bec0-e45db3f51a74 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:35.023261 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f138a344-7cc2-4fde-bec0-e45db3f51a74 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.159843 May 25 14:58:35.023824 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 147/285] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:34 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:35.378360 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-f42851b5-65a3-47a1-a84b-1870d7d6d55b tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:35.378922 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-f42851b5-65a3-47a1-a84b-1870d7d6d55b tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:35.385962 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f42851b5-65a3-47a1-a84b-1870d7d6d55b tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:35.386515 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f42851b5-65a3-47a1-a84b-1870d7d6d55b tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:35.387171 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f42851b5-65a3-47a1-a84b-1870d7d6d55b tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:35.387603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f42851b5-65a3-47a1-a84b-1870d7d6d55b tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:35.523292 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-f42851b5-65a3-47a1-a84b-1870d7d6d55b tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:35.530735 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-f42851b5-65a3-47a1-a84b-1870d7d6d55b tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.156397 May 25 14:58:35.531297 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 139/286] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:35 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:58:36.040520 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-c2af0bca-aae5-4d7a-9f8e-9218fba47f1c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:36.041263 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-c2af0bca-aae5-4d7a-9f8e-9218fba47f1c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:36.047749 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c2af0bca-aae5-4d7a-9f8e-9218fba47f1c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:36.048197 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c2af0bca-aae5-4d7a-9f8e-9218fba47f1c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:36.049302 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c2af0bca-aae5-4d7a-9f8e-9218fba47f1c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:36.049743 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c2af0bca-aae5-4d7a-9f8e-9218fba47f1c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:36.186302 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-c2af0bca-aae5-4d7a-9f8e-9218fba47f1c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:36.193871 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-c2af0bca-aae5-4d7a-9f8e-9218fba47f1c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.157218 May 25 14:58:36.194476 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 148/287] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:36 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:36.547472 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-93899774-0795-44fb-847a-44dd8ed6a0dd tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:36.548085 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-93899774-0795-44fb-847a-44dd8ed6a0dd tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:36.554969 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-93899774-0795-44fb-847a-44dd8ed6a0dd tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:36.555409 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-93899774-0795-44fb-847a-44dd8ed6a0dd tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:36.556190 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-93899774-0795-44fb-847a-44dd8ed6a0dd tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:36.556620 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-93899774-0795-44fb-847a-44dd8ed6a0dd tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:36.696930 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-93899774-0795-44fb-847a-44dd8ed6a0dd tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:36.705092 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-93899774-0795-44fb-847a-44dd8ed6a0dd tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.161399 May 25 14:58:36.705676 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 140/288] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:36 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:37.211592 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a865f834-568e-4a2f-8a0d-80712a404533 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:37.212194 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a865f834-568e-4a2f-8a0d-80712a404533 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:37.218790 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a865f834-568e-4a2f-8a0d-80712a404533 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:37.219274 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a865f834-568e-4a2f-8a0d-80712a404533 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:37.220055 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a865f834-568e-4a2f-8a0d-80712a404533 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:37.220488 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a865f834-568e-4a2f-8a0d-80712a404533 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:37.361570 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a865f834-568e-4a2f-8a0d-80712a404533 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:37.370233 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a865f834-568e-4a2f-8a0d-80712a404533 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.162500 May 25 14:58:37.370878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 149/289] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:37 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:37.723589 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b00d8de5-8972-426f-afac-12cdcf307970 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:37.724175 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b00d8de5-8972-426f-afac-12cdcf307970 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:37.732688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b00d8de5-8972-426f-afac-12cdcf307970 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:37.733146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b00d8de5-8972-426f-afac-12cdcf307970 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:37.733941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b00d8de5-8972-426f-afac-12cdcf307970 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:37.734414 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b00d8de5-8972-426f-afac-12cdcf307970 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:37.866963 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b00d8de5-8972-426f-afac-12cdcf307970 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:37.875690 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b00d8de5-8972-426f-afac-12cdcf307970 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.156112 May 25 14:58:37.876238 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 141/290] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:37 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:58:37.932964 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8f6e19fa-24a0-497d-8526-d879be5aab8e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:37.933549 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8f6e19fa-24a0-497d-8526-d879be5aab8e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:37.940098 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8f6e19fa-24a0-497d-8526-d879be5aab8e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:37.940617 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8f6e19fa-24a0-497d-8526-d879be5aab8e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:37.941305 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8f6e19fa-24a0-497d-8526-d879be5aab8e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:37.941735 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8f6e19fa-24a0-497d-8526-d879be5aab8e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:37.965650 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8f6e19fa-24a0-497d-8526-d879be5aab8e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912/ips" status: 200 len: 145 microversion: 2.1 time: 0.037218 May 25 14:58:37.966326 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 150/291] 10.222.0.78 () {58 vars in 1247 bytes} [Wed May 25 14:58:37 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:58:38.101011 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-6659dc49-48ad-4015-b0d1-0569827b73b2 req-52eca742-0aca-4af7-b082-c1a7a6f232a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca91c55-a0f9-486e-8dd2-0165ec619867", "name": "network-vif-plugged", "status": "completed", "tag": "464a46c2-9b37-4e50-ba29-ae60e63b45f1"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:58:38.109916 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-6659dc49-48ad-4015-b0d1-0569827b73b2 req-52eca742-0aca-4af7-b082-c1a7a6f232a9 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:38.110432 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-6659dc49-48ad-4015-b0d1-0569827b73b2 req-52eca742-0aca-4af7-b082-c1a7a6f232a9 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:38.114633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:38.123497 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-6659dc49-48ad-4015-b0d1-0569827b73b2 req-52eca742-0aca-4af7-b082-c1a7a6f232a9 service nova] Creating event network-vif-plugged:464a46c2-9b37-4e50-ba29-ae60e63b45f1 for instance 7ca91c55-a0f9-486e-8dd2-0165ec619867 on hv-cinder-80382 May 25 14:58:38.128815 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-6659dc49-48ad-4015-b0d1-0569827b73b2 req-52eca742-0aca-4af7-b082-c1a7a6f232a9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031466 May 25 14:58:38.129751 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 142/292] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:58:38.388817 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-04cfdaaa-cb1f-401f-9a5e-a27e22d7799b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:38.389584 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-04cfdaaa-cb1f-401f-9a5e-a27e22d7799b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:38.396538 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-04cfdaaa-cb1f-401f-9a5e-a27e22d7799b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:38.397138 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-04cfdaaa-cb1f-401f-9a5e-a27e22d7799b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:38.398067 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-04cfdaaa-cb1f-401f-9a5e-a27e22d7799b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:38.398657 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-04cfdaaa-cb1f-401f-9a5e-a27e22d7799b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:38.621898 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-04cfdaaa-cb1f-401f-9a5e-a27e22d7799b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:38.636837 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-04cfdaaa-cb1f-401f-9a5e-a27e22d7799b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.253355 May 25 14:58:38.637714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 151/293] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:38 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:38.894262 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-91769ea8-faf8-4b1e-bf89-ca5a9c728f70 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:38.894973 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-91769ea8-faf8-4b1e-bf89-ca5a9c728f70 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:38.902033 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-91769ea8-faf8-4b1e-bf89-ca5a9c728f70 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:38.902709 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-91769ea8-faf8-4b1e-bf89-ca5a9c728f70 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:38.903479 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-91769ea8-faf8-4b1e-bf89-ca5a9c728f70 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:38.904115 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-91769ea8-faf8-4b1e-bf89-ca5a9c728f70 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:39.041400 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-91769ea8-faf8-4b1e-bf89-ca5a9c728f70 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:39.056701 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-91769ea8-faf8-4b1e-bf89-ca5a9c728f70 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.167195 May 25 14:58:39.057296 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 143/294] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:38 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:39.654650 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4bca1ebd-914d-4c0e-9a24-92da8988dd13 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:39.655199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4bca1ebd-914d-4c0e-9a24-92da8988dd13 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:39.661203 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4bca1ebd-914d-4c0e-9a24-92da8988dd13 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:39.661650 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4bca1ebd-914d-4c0e-9a24-92da8988dd13 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:39.662447 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4bca1ebd-914d-4c0e-9a24-92da8988dd13 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:39.662887 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4bca1ebd-914d-4c0e-9a24-92da8988dd13 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:39.792773 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4bca1ebd-914d-4c0e-9a24-92da8988dd13 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:39.800230 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4bca1ebd-914d-4c0e-9a24-92da8988dd13 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.149603 May 25 14:58:39.800802 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 152/295] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:39 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:40.075868 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-01c212cf-3d41-4b9a-8c41-17ba8a5c1a85 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:40.076583 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-01c212cf-3d41-4b9a-8c41-17ba8a5c1a85 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:40.083190 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-01c212cf-3d41-4b9a-8c41-17ba8a5c1a85 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:40.083635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-01c212cf-3d41-4b9a-8c41-17ba8a5c1a85 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:40.084400 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-01c212cf-3d41-4b9a-8c41-17ba8a5c1a85 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:40.084834 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-01c212cf-3d41-4b9a-8c41-17ba8a5c1a85 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:40.212628 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-01c212cf-3d41-4b9a-8c41-17ba8a5c1a85 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:40.219998 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-01c212cf-3d41-4b9a-8c41-17ba8a5c1a85 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.148648 May 25 14:58:40.220559 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 144/296] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:40 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:40.816710 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4d2b9b9c-b025-4946-980d-0cf780264949 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:40.817351 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4d2b9b9c-b025-4946-980d-0cf780264949 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:40.823435 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4d2b9b9c-b025-4946-980d-0cf780264949 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:40.823906 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4d2b9b9c-b025-4946-980d-0cf780264949 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:40.826484 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4d2b9b9c-b025-4946-980d-0cf780264949 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:40.826484 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4d2b9b9c-b025-4946-980d-0cf780264949 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:40.827845 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=100 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:40.963120 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4d2b9b9c-b025-4946-980d-0cf780264949 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:40.971552 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4d2b9b9c-b025-4946-980d-0cf780264949 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.158425 May 25 14:58:40.972810 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 153/297] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:40 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:58:41.236659 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7164caef-c7a7-49c9-9dd4-bd8fd90fb2f8 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:41.237276 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7164caef-c7a7-49c9-9dd4-bd8fd90fb2f8 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:41.244436 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7164caef-c7a7-49c9-9dd4-bd8fd90fb2f8 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:41.244889 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7164caef-c7a7-49c9-9dd4-bd8fd90fb2f8 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:41.245664 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7164caef-c7a7-49c9-9dd4-bd8fd90fb2f8 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:41.246121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7164caef-c7a7-49c9-9dd4-bd8fd90fb2f8 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:41.387677 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7164caef-c7a7-49c9-9dd4-bd8fd90fb2f8 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:41.395933 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7164caef-c7a7-49c9-9dd4-bd8fd90fb2f8 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.163019 May 25 14:58:41.396521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 145/298] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:41 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:41.992093 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2facc6dc-f43c-4792-8426-9f7b0dc85c8f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:41.992974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2facc6dc-f43c-4792-8426-9f7b0dc85c8f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:41.999591 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2facc6dc-f43c-4792-8426-9f7b0dc85c8f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:42.000094 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2facc6dc-f43c-4792-8426-9f7b0dc85c8f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:42.000890 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2facc6dc-f43c-4792-8426-9f7b0dc85c8f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:42.001368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2facc6dc-f43c-4792-8426-9f7b0dc85c8f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:42.145650 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2facc6dc-f43c-4792-8426-9f7b0dc85c8f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:42.153868 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2facc6dc-f43c-4792-8426-9f7b0dc85c8f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.167103 May 25 14:58:42.154483 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 154/299] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:41 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:42.412936 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1c579e12-a516-4287-b25c-525718704fa0 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:42.413463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1c579e12-a516-4287-b25c-525718704fa0 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:42.420231 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1c579e12-a516-4287-b25c-525718704fa0 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:42.420675 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1c579e12-a516-4287-b25c-525718704fa0 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:42.421477 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1c579e12-a516-4287-b25c-525718704fa0 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:42.421919 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1c579e12-a516-4287-b25c-525718704fa0 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:42.566554 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1c579e12-a516-4287-b25c-525718704fa0 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:42.574914 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1c579e12-a516-4287-b25c-525718704fa0 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.165910 May 25 14:58:42.575485 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 146/300] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:42 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:43.171560 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-756ed94e-9967-4b22-aa43-452eb58f65a0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:43.172179 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-756ed94e-9967-4b22-aa43-452eb58f65a0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:43.178440 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-756ed94e-9967-4b22-aa43-452eb58f65a0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:43.178897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-756ed94e-9967-4b22-aa43-452eb58f65a0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:43.179673 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-756ed94e-9967-4b22-aa43-452eb58f65a0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:43.180121 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-756ed94e-9967-4b22-aa43-452eb58f65a0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:43.318281 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-756ed94e-9967-4b22-aa43-452eb58f65a0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:43.326601 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-756ed94e-9967-4b22-aa43-452eb58f65a0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.159158 May 25 14:58:43.327171 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 155/301] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:43 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:43.591657 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-fec520fa-44d1-40e0-a0cb-6c54cbeb98ea tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:43.592271 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-fec520fa-44d1-40e0-a0cb-6c54cbeb98ea tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:43.599227 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fec520fa-44d1-40e0-a0cb-6c54cbeb98ea tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:43.599859 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fec520fa-44d1-40e0-a0cb-6c54cbeb98ea tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:43.600863 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fec520fa-44d1-40e0-a0cb-6c54cbeb98ea tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:43.601395 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fec520fa-44d1-40e0-a0cb-6c54cbeb98ea tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:43.749649 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-fec520fa-44d1-40e0-a0cb-6c54cbeb98ea tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:43.760113 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-fec520fa-44d1-40e0-a0cb-6c54cbeb98ea tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1314 microversion: 2.1 time: 0.172413 May 25 14:58:43.760731 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 147/302] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:43 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:44.353718 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-23d03d17-1f94-4d92-9f3f-f8dcfbd02013 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:44.355591 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-23d03d17-1f94-4d92-9f3f-f8dcfbd02013 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:44.371142 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-23d03d17-1f94-4d92-9f3f-f8dcfbd02013 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:44.371987 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-23d03d17-1f94-4d92-9f3f-f8dcfbd02013 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:44.374345 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-23d03d17-1f94-4d92-9f3f-f8dcfbd02013 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:44.375374 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-23d03d17-1f94-4d92-9f3f-f8dcfbd02013 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:44.553852 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-23d03d17-1f94-4d92-9f3f-f8dcfbd02013 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:44.562033 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-23d03d17-1f94-4d92-9f3f-f8dcfbd02013 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.218160 May 25 14:58:44.562594 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 156/303] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:44 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:44.576432 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-c026380c-316b-45ea-98e1-365f36034ebd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e376299-8aaa-4648-9d35-17ebb9e5e3e0"}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:58:44.578119 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-c026380c-316b-45ea-98e1-365f36034ebd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:44.585475 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c026380c-316b-45ea-98e1-365f36034ebd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:44.585926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c026380c-316b-45ea-98e1-365f36034ebd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:44.586737 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c026380c-316b-45ea-98e1-365f36034ebd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:44.587702 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c026380c-316b-45ea-98e1-365f36034ebd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:44.779426 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a49223cd-d0bb-43be-a5d1-49f913600032 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:44.780058 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a49223cd-d0bb-43be-a5d1-49f913600032 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:44.786499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a49223cd-d0bb-43be-a5d1-49f913600032 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:44.787041 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a49223cd-d0bb-43be-a5d1-49f913600032 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:44.787948 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a49223cd-d0bb-43be-a5d1-49f913600032 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:44.788471 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a49223cd-d0bb-43be-a5d1-49f913600032 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:44.965757 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a49223cd-d0bb-43be-a5d1-49f913600032 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:44.975794 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a49223cd-d0bb-43be-a5d1-49f913600032 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1463 microversion: 2.1 time: 0.201833 May 25 14:58:44.977226 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 157/304] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:44 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1463 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:58:45.024465 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-5d67d949-abb5-44b5-93c3-de6f52dfce82 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:45.025181 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-5d67d949-abb5-44b5-93c3-de6f52dfce82 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:45.032991 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5d67d949-abb5-44b5-93c3-de6f52dfce82 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:45.033430 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5d67d949-abb5-44b5-93c3-de6f52dfce82 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:45.034191 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5d67d949-abb5-44b5-93c3-de6f52dfce82 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:45.034635 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5d67d949-abb5-44b5-93c3-de6f52dfce82 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:45.063354 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-5d67d949-abb5-44b5-93c3-de6f52dfce82 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Going to try to terminate instance {{(pid=124523) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 14:58:45.173373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-5d67d949-abb5-44b5-93c3-de6f52dfce82 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 204 len: 0 microversion: 2.1 time: 0.152893 May 25 14:58:45.178840 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 158/305] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 14:58:45 2022] DELETE /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 14:58:45.188449 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-634e280e-f294-461d-a1e8-ce49093c3fde tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:45.189296 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-634e280e-f294-461d-a1e8-ce49093c3fde tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:45.197331 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-634e280e-f294-461d-a1e8-ce49093c3fde tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:45.197781 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-634e280e-f294-461d-a1e8-ce49093c3fde tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:45.198579 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-634e280e-f294-461d-a1e8-ce49093c3fde tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:45.199008 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-634e280e-f294-461d-a1e8-ce49093c3fde tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:45.380968 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-634e280e-f294-461d-a1e8-ce49093c3fde tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:45.393950 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-634e280e-f294-461d-a1e8-ce49093c3fde tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1469 microversion: 2.1 time: 0.209651 May 25 14:58:45.394815 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 159/306] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:45 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1469 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:58:45.580557 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f8bee0c5-0294-4fd7-a683-7ffadaecc2b2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:45.581331 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f8bee0c5-0294-4fd7-a683-7ffadaecc2b2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:45.588707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f8bee0c5-0294-4fd7-a683-7ffadaecc2b2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:45.589553 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f8bee0c5-0294-4fd7-a683-7ffadaecc2b2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:45.590199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f8bee0c5-0294-4fd7-a683-7ffadaecc2b2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:45.590848 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f8bee0c5-0294-4fd7-a683-7ffadaecc2b2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:45.746698 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f8bee0c5-0294-4fd7-a683-7ffadaecc2b2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:45.754570 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f8bee0c5-0294-4fd7-a683-7ffadaecc2b2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.179257 May 25 14:58:45.755153 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 160/307] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:45 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:58:46.413991 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-fea1da6f-e57c-4848-9dfa-be36cf3e809a tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:46.414700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-fea1da6f-e57c-4848-9dfa-be36cf3e809a tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:46.421756 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fea1da6f-e57c-4848-9dfa-be36cf3e809a tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:46.422303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fea1da6f-e57c-4848-9dfa-be36cf3e809a tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:46.423144 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fea1da6f-e57c-4848-9dfa-be36cf3e809a tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:46.423679 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fea1da6f-e57c-4848-9dfa-be36cf3e809a tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:46.579760 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-fea1da6f-e57c-4848-9dfa-be36cf3e809a tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:46.590393 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-fea1da6f-e57c-4848-9dfa-be36cf3e809a tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1469 microversion: 2.1 time: 0.180304 May 25 14:58:46.591237 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 161/308] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:46 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1469 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:58:46.772958 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-91683aa9-9bc3-49f4-bd99-b454e098fe69 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:46.773951 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-91683aa9-9bc3-49f4-bd99-b454e098fe69 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:46.781830 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-91683aa9-9bc3-49f4-bd99-b454e098fe69 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:46.782600 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-91683aa9-9bc3-49f4-bd99-b454e098fe69 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:46.783418 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-91683aa9-9bc3-49f4-bd99-b454e098fe69 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:46.784032 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-91683aa9-9bc3-49f4-bd99-b454e098fe69 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:46.938421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-91683aa9-9bc3-49f4-bd99-b454e098fe69 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:46.946254 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-91683aa9-9bc3-49f4-bd99-b454e098fe69 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.177197 May 25 14:58:46.946871 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 162/309] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:46 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:58:47.607550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d6de06e2-3e9d-41d5-9d0f-392f2de5454c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:47.608180 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d6de06e2-3e9d-41d5-9d0f-392f2de5454c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:47.614603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d6de06e2-3e9d-41d5-9d0f-392f2de5454c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:47.615051 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d6de06e2-3e9d-41d5-9d0f-392f2de5454c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:47.615834 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d6de06e2-3e9d-41d5-9d0f-392f2de5454c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:47.616267 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d6de06e2-3e9d-41d5-9d0f-392f2de5454c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:47.769699 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d6de06e2-3e9d-41d5-9d0f-392f2de5454c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:47.779578 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d6de06e2-3e9d-41d5-9d0f-392f2de5454c tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1469 microversion: 2.1 time: 0.176003 May 25 14:58:47.780249 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 163/310] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:47 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1469 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:47.961483 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-c026380c-316b-45ea-98e1-365f36034ebd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "POST /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.390390 May 25 14:58:47.966846 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-c25421a8-4921-4fc9-9433-8b5d3358afa9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:47.971589 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-c25421a8-4921-4fc9-9433-8b5d3358afa9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:47.971789 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 148/311] 10.222.0.78 () {60 vars in 1322 bytes} [Wed May 25 14:58:44 2022] POST /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912/os-volume_attachments => generated 194 bytes in 3398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:58:47.974619 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c25421a8-4921-4fc9-9433-8b5d3358afa9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:47.975159 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c25421a8-4921-4fc9-9433-8b5d3358afa9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:47.976076 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c25421a8-4921-4fc9-9433-8b5d3358afa9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:47.976613 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c25421a8-4921-4fc9-9433-8b5d3358afa9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:48.122326 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-c25421a8-4921-4fc9-9433-8b5d3358afa9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:48.131581 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-c25421a8-4921-4fc9-9433-8b5d3358afa9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.170416 May 25 14:58:48.132169 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 164/312] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:47 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:58:48.798659 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2589e8d2-66e7-4651-a63c-40b1f8f3ebdd tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:48.799638 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2589e8d2-66e7-4651-a63c-40b1f8f3ebdd tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:48.807887 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2589e8d2-66e7-4651-a63c-40b1f8f3ebdd tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:48.808710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2589e8d2-66e7-4651-a63c-40b1f8f3ebdd tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:48.810285 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2589e8d2-66e7-4651-a63c-40b1f8f3ebdd tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:48.811145 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2589e8d2-66e7-4651-a63c-40b1f8f3ebdd tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:48.819586 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8aeb96f1-8c49-473a-8d7b-e46c378baa5f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:48.820611 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8aeb96f1-8c49-473a-8d7b-e46c378baa5f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:48.830728 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8aeb96f1-8c49-473a-8d7b-e46c378baa5f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:48.831651 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8aeb96f1-8c49-473a-8d7b-e46c378baa5f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:48.833173 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8aeb96f1-8c49-473a-8d7b-e46c378baa5f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:48.834690 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8aeb96f1-8c49-473a-8d7b-e46c378baa5f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:48.871573 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8aeb96f1-8c49-473a-8d7b-e46c378baa5f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3/ips" status: 200 len: 150 microversion: 2.1 time: 0.060669 May 25 14:58:48.872841 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 165/313] 10.222.0.78 () {58 vars in 1247 bytes} [Wed May 25 14:58:48 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3/ips => generated 150 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:58:49.013440 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-2589e8d2-66e7-4651-a63c-40b1f8f3ebdd tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:49.026132 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2589e8d2-66e7-4651-a63c-40b1f8f3ebdd tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1469 microversion: 2.1 time: 0.230027 May 25 14:58:49.027039 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 149/314] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:48 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1469 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:49.152134 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-49b547c3-bbe0-4202-bed0-d7e8e308afbe tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:49.158926 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-49b547c3-bbe0-4202-bed0-d7e8e308afbe tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:49.167295 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-49b547c3-bbe0-4202-bed0-d7e8e308afbe tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:49.167737 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-49b547c3-bbe0-4202-bed0-d7e8e308afbe tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:49.168540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-49b547c3-bbe0-4202-bed0-d7e8e308afbe tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:49.168972 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-49b547c3-bbe0-4202-bed0-d7e8e308afbe tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:49.325334 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-481d7abd-de74-48eb-8c9f-b4b298ba9272 req-7d57f6ad-7fb8-4f50-8ea6-aaf9b1d544d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca91c55-a0f9-486e-8dd2-0165ec619867", "name": "network-vif-deleted", "tag": "464a46c2-9b37-4e50-ba29-ae60e63b45f1"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:58:49.348296 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-481d7abd-de74-48eb-8c9f-b4b298ba9272 req-7d57f6ad-7fb8-4f50-8ea6-aaf9b1d544d0 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:49.348737 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-481d7abd-de74-48eb-8c9f-b4b298ba9272 req-7d57f6ad-7fb8-4f50-8ea6-aaf9b1d544d0 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:49.366257 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-481d7abd-de74-48eb-8c9f-b4b298ba9272 req-7d57f6ad-7fb8-4f50-8ea6-aaf9b1d544d0 service nova] Creating event network-vif-deleted:464a46c2-9b37-4e50-ba29-ae60e63b45f1 for instance 7ca91c55-a0f9-486e-8dd2-0165ec619867 on hv-cinder-80382 May 25 14:58:49.377077 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-481d7abd-de74-48eb-8c9f-b4b298ba9272 req-7d57f6ad-7fb8-4f50-8ea6-aaf9b1d544d0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055974 May 25 14:58:49.379817 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 150/315] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:58:49.495631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-49b547c3-bbe0-4202-bed0-d7e8e308afbe tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:49.504897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-49b547c3-bbe0-4202-bed0-d7e8e308afbe tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.357576 May 25 14:58:49.505955 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 166/316] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:49 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:50.045427 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2147c9be-7a65-4a14-997f-831c88884e07 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:50.046258 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2147c9be-7a65-4a14-997f-831c88884e07 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:50.060141 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2147c9be-7a65-4a14-997f-831c88884e07 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:50.060666 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2147c9be-7a65-4a14-997f-831c88884e07 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:50.061459 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2147c9be-7a65-4a14-997f-831c88884e07 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:50.061896 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2147c9be-7a65-4a14-997f-831c88884e07 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:50.142445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2147c9be-7a65-4a14-997f-831c88884e07 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:50.142921 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2147c9be-7a65-4a14-997f-831c88884e07 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:50.143375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-2147c9be-7a65-4a14-997f-831c88884e07 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lazy-loading 'fault' on Instance uuid 7ca91c55-a0f9-486e-8dd2-0165ec619867 {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 14:58:50.239149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-2147c9be-7a65-4a14-997f-831c88884e07 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ca7cd35d451ba228a058892f2da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56174c2dc6ce472697756899661f4838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:50.251974 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2147c9be-7a65-4a14-997f-831c88884e07 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 200 len: 1304 microversion: 2.1 time: 0.211815 May 25 14:58:50.263259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 151/317] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:50 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 1304 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:58:50.523880 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-271f8fc0-ffb2-46ba-b8cd-6b7159c87d92 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:50.525139 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-271f8fc0-ffb2-46ba-b8cd-6b7159c87d92 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:50.537861 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-271f8fc0-ffb2-46ba-b8cd-6b7159c87d92 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:50.539864 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-271f8fc0-ffb2-46ba-b8cd-6b7159c87d92 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:50.541096 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-271f8fc0-ffb2-46ba-b8cd-6b7159c87d92 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:50.545490 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-271f8fc0-ffb2-46ba-b8cd-6b7159c87d92 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:50.897980 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-271f8fc0-ffb2-46ba-b8cd-6b7159c87d92 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:50.906713 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-271f8fc0-ffb2-46ba-b8cd-6b7159c87d92 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.387821 May 25 14:58:50.909690 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 167/318] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:50 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:58:51.158472 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-52626b8c-5717-4f52-8b8a-27c214c30c71 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6dca455f-d4fd-44bc-a04d-ded950741f76"}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:58:51.161814 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-52626b8c-5717-4f52-8b8a-27c214c30c71 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:51.177220 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-52626b8c-5717-4f52-8b8a-27c214c30c71 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:51.178396 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-52626b8c-5717-4f52-8b8a-27c214c30c71 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:51.179717 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-52626b8c-5717-4f52-8b8a-27c214c30c71 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:51.180459 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-52626b8c-5717-4f52-8b8a-27c214c30c71 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:51.271443 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-7c518e55-5401-4767-ac9b-61056ec34d73 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:51.272060 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-7c518e55-5401-4767-ac9b-61056ec34d73 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] [instance: 7ca91c55-a0f9-486e-8dd2-0165ec619867] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:51.281751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7c518e55-5401-4767-ac9b-61056ec34d73 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:51.286249 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7c518e55-5401-4767-ac9b-61056ec34d73 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:51.287745 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7c518e55-5401-4767-ac9b-61056ec34d73 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:51.288559 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7c518e55-5401-4767-ac9b-61056ec34d73 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:51.313091 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-7c518e55-5401-4767-ac9b-61056ec34d73 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] HTTP exception thrown: Instance 7ca91c55-a0f9-486e-8dd2-0165ec619867 could not be found. May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-7c518e55-5401-4767-ac9b-61056ec34d73 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Request method failure captured: May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 HTTP/1.1 May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkP_L7qpqQThCfS0RukUPWqd0c7Y9JBa9UphKiWcwMgp-R2B2fuHVB8cyPHh94dtOR05H7UXr7bHRyjjAhR0pXYWwFiFgcX6hI7ldp-IEfVPE_cY9pfyOWDxQp-VRGrfoC7UTGYuhDH4QQfGkS5YGA5aovWGH7m-dn5uhBD4ZXlTulc May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 56174c2dc6ce472697756899661f4838 May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-VolumesNegativeTest-2146910906 May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 14:58:51.314822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 14:58:51.316303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_56174c2dc6ce472697756899661f4838"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/56174c2dc6ce472697756899661f4838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56174c2dc6ce472697756899661f4838"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56174c2dc6ce472697756899661f4838"}]}] May 25 14:58:51.316303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-VolumesNegativeTest-2146910906 May 25 14:58:51.316303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 56174c2dc6ce472697756899661f4838 May 25 14:58:51.316303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-VolumesNegativeTest-2146910906 May 25 14:58:51.316303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-VolumesNegativeTest-2146910906-project May 25 14:58:51.316303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 14:58:51.316303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 14:58:51.316303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: aef8ca7cd35d451ba228a058892f2da4 May 25 14:58:51.316303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-VolumesNegativeTest-2146910906-project May 25 14:58:51.316303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 14:58:51.316303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance 7ca91c55-a0f9-486e-8dd2-0165ec619867 could not be found. May 25 14:58:51.316303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': '7ca91c55-a0f9-486e-8dd2-0165ec619867'} May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca91c55-a0f9-486e-8dd2-0165ec619867 could not be found. May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:58:51.317242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:58:51.319431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:58:51.319431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 14:58:51.319431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 14:58:51.319431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 14:58:51.319431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 14:58:51.319431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 14:58:51.319431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:58:51.319431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca91c55-a0f9-486e-8dd2-0165ec619867 could not be found. May 25 14:58:51.319431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:58:51.319431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:58:51.319431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:58:51.319431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:58:51.319431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:58:51.319431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:58:51.319431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:58:51.319431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:58:51.319431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca91c55-a0f9-486e-8dd2-0165ec619867 could not be found. May 25 14:58:51.319431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 14:58:51.328727 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-7c518e55-5401-4767-ac9b-61056ec34d73 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] Returning 404 to user: Instance 7ca91c55-a0f9-486e-8dd2-0165ec619867 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:58:51.328727 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-7c518e55-5401-4767-ac9b-61056ec34d73 tempest-VolumesNegativeTest-2146910906 tempest-VolumesNegativeTest-2146910906-project] 10.222.0.78 "GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867" status: 404 len: 111 microversion: 2.1 time: 0.050755 May 25 14:58:51.328727 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 168/319] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:51 2022] GET /compute/v2.1/servers/7ca91c55-a0f9-486e-8dd2-0165ec619867 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 14:58:51.926933 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-770d1b84-6043-479d-b273-2ac8201368e4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:51.927575 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-770d1b84-6043-479d-b273-2ac8201368e4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:51.935826 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-770d1b84-6043-479d-b273-2ac8201368e4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:51.936474 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-770d1b84-6043-479d-b273-2ac8201368e4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:51.937447 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-770d1b84-6043-479d-b273-2ac8201368e4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:51.937873 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-770d1b84-6043-479d-b273-2ac8201368e4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:51.942760 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:52.089302 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-52626b8c-5717-4f52-8b8a-27c214c30c71 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "POST /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.939702 May 25 14:58:52.095183 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 152/320] 10.222.0.78 () {60 vars in 1322 bytes} [Wed May 25 14:58:51 2022] POST /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3/os-volume_attachments => generated 194 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:58:52.259569 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-770d1b84-6043-479d-b273-2ac8201368e4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:52.269133 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-770d1b84-6043-479d-b273-2ac8201368e4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.347023 May 25 14:58:52.269718 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 169/321] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:51 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:58:53.287439 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b109b0c6-56ef-4eb2-8de4-e5a12cb9dda1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:53.288304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b109b0c6-56ef-4eb2-8de4-e5a12cb9dda1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:53.296120 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b109b0c6-56ef-4eb2-8de4-e5a12cb9dda1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:53.296957 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b109b0c6-56ef-4eb2-8de4-e5a12cb9dda1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:53.298049 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b109b0c6-56ef-4eb2-8de4-e5a12cb9dda1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:53.298979 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b109b0c6-56ef-4eb2-8de4-e5a12cb9dda1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:53.501403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b109b0c6-56ef-4eb2-8de4-e5a12cb9dda1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:53.516569 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b109b0c6-56ef-4eb2-8de4-e5a12cb9dda1 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.234027 May 25 14:58:53.518265 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 153/322] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:53 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:54.539000 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f52004a7-0f87-4e4b-898e-011f1e98817a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:54.540711 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f52004a7-0f87-4e4b-898e-011f1e98817a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:54.549273 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f52004a7-0f87-4e4b-898e-011f1e98817a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:54.551165 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f52004a7-0f87-4e4b-898e-011f1e98817a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:54.552524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f52004a7-0f87-4e4b-898e-011f1e98817a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:54.554478 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f52004a7-0f87-4e4b-898e-011f1e98817a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:54.785271 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f52004a7-0f87-4e4b-898e-011f1e98817a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:54.807923 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f52004a7-0f87-4e4b-898e-011f1e98817a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.276704 May 25 14:58:54.808519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 170/323] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:54 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:55.845371 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-dc67690f-7236-4ba4-afc1-7ecc83ecbdc4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:55.845916 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-dc67690f-7236-4ba4-afc1-7ecc83ecbdc4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:55.862644 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dc67690f-7236-4ba4-afc1-7ecc83ecbdc4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:55.862644 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dc67690f-7236-4ba4-afc1-7ecc83ecbdc4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:55.862644 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dc67690f-7236-4ba4-afc1-7ecc83ecbdc4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:55.862954 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dc67690f-7236-4ba4-afc1-7ecc83ecbdc4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:56.098737 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-dc67690f-7236-4ba4-afc1-7ecc83ecbdc4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:56.108504 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-dc67690f-7236-4ba4-afc1-7ecc83ecbdc4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.268248 May 25 14:58:56.109194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 154/324] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:55 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:57.126542 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b19fd3ee-5308-4b6e-9025-d8c35121f94f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:57.128157 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-b19fd3ee-5308-4b6e-9025-d8c35121f94f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:57.135478 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b19fd3ee-5308-4b6e-9025-d8c35121f94f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:57.136432 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b19fd3ee-5308-4b6e-9025-d8c35121f94f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:57.137387 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b19fd3ee-5308-4b6e-9025-d8c35121f94f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:57.157762 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b19fd3ee-5308-4b6e-9025-d8c35121f94f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:57.543377 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-b19fd3ee-5308-4b6e-9025-d8c35121f94f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:57.559127 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-b19fd3ee-5308-4b6e-9025-d8c35121f94f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.436522 May 25 14:58:57.560116 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 171/325] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:57 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:57.739115 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-da819a2b-82af-416f-93b9-e5c85877d32f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:58:57.743990 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=48 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:57.754876 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-da819a2b-82af-416f-93b9-e5c85877d32f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:57.755319 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-da819a2b-82af-416f-93b9-e5c85877d32f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:57.918300 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-da819a2b-82af-416f-93b9-e5c85877d32f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Going to try to stop instance {{(pid=124524) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 25 14:58:58.128724 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-da819a2b-82af-416f-93b9-e5c85877d32f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "POST /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912/action" status: 202 len: 0 microversion: 2.1 time: 0.393068 May 25 14:58:58.130620 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 155/326] 10.222.0.78 () {60 vars in 1277 bytes} [Wed May 25 14:58:57 2022] POST /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 14:58:58.146298 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8ac73a7c-a24e-448e-868e-547a12b065e4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:58.147114 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8ac73a7c-a24e-448e-868e-547a12b065e4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:58.165575 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8ac73a7c-a24e-448e-868e-547a12b065e4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:58.166052 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8ac73a7c-a24e-448e-868e-547a12b065e4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:58.167251 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8ac73a7c-a24e-448e-868e-547a12b065e4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:58.168389 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8ac73a7c-a24e-448e-868e-547a12b065e4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:58.585130 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7fa5106f-9721-48b3-99ff-abed06c6526c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:58.586268 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7fa5106f-9721-48b3-99ff-abed06c6526c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:58.596798 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8ac73a7c-a24e-448e-868e-547a12b065e4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:58.605182 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8ac73a7c-a24e-448e-868e-547a12b065e4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1720 microversion: 2.1 time: 0.470139 May 25 14:58:58.605776 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 172/327] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:58 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1720 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:58.611326 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7fa5106f-9721-48b3-99ff-abed06c6526c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:58.612129 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7fa5106f-9721-48b3-99ff-abed06c6526c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:58.613402 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7fa5106f-9721-48b3-99ff-abed06c6526c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:58.614860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7fa5106f-9721-48b3-99ff-abed06c6526c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:58.626789 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:58.960036 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7fa5106f-9721-48b3-99ff-abed06c6526c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:58.972116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7fa5106f-9721-48b3-99ff-abed06c6526c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.391034 May 25 14:58:58.974320 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 156/328] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:58 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:58:59.627523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-30cdd32f-6952-4efc-a2cc-fe0fcc963900 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:59.628866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-30cdd32f-6952-4efc-a2cc-fe0fcc963900 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:59.666317 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-30cdd32f-6952-4efc-a2cc-fe0fcc963900 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:59.667497 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-30cdd32f-6952-4efc-a2cc-fe0fcc963900 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:59.668355 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-30cdd32f-6952-4efc-a2cc-fe0fcc963900 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:59.668803 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-30cdd32f-6952-4efc-a2cc-fe0fcc963900 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:59.963988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-30cdd32f-6952-4efc-a2cc-fe0fcc963900 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:59.994619 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-30cdd32f-6952-4efc-a2cc-fe0fcc963900 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1720 microversion: 2.1 time: 0.372278 May 25 14:58:59.997814 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 173/329] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:59 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1720 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:00.014176 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0d7ae21b-8099-4402-a3e7-713d98198ac0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:00.015702 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0d7ae21b-8099-4402-a3e7-713d98198ac0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:00.032267 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0d7ae21b-8099-4402-a3e7-713d98198ac0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:00.034749 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0d7ae21b-8099-4402-a3e7-713d98198ac0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:00.038035 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0d7ae21b-8099-4402-a3e7-713d98198ac0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:00.066645 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0d7ae21b-8099-4402-a3e7-713d98198ac0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:00.430975 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-0d7ae21b-8099-4402-a3e7-713d98198ac0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:00.447212 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0d7ae21b-8099-4402-a3e7-713d98198ac0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.457991 May 25 14:59:00.448242 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 157/330] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:58:59 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:01.016008 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2792735a-de33-4692-85f7-3b2456eed368 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:01.016734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2792735a-de33-4692-85f7-3b2456eed368 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:01.026823 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2792735a-de33-4692-85f7-3b2456eed368 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:01.029188 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2792735a-de33-4692-85f7-3b2456eed368 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:01.031748 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2792735a-de33-4692-85f7-3b2456eed368 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:01.034080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2792735a-de33-4692-85f7-3b2456eed368 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:01.273697 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2792735a-de33-4692-85f7-3b2456eed368 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:01.313652 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2792735a-de33-4692-85f7-3b2456eed368 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1720 microversion: 2.1 time: 0.301738 May 25 14:59:01.325487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 174/331] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:01 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1720 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:01.473099 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-81125959-91e3-48e2-9bfb-cc6e846556ea tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:01.474572 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-81125959-91e3-48e2-9bfb-cc6e846556ea tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:01.496492 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-81125959-91e3-48e2-9bfb-cc6e846556ea tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:01.505923 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-81125959-91e3-48e2-9bfb-cc6e846556ea tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:01.516471 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-81125959-91e3-48e2-9bfb-cc6e846556ea tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:01.519333 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-81125959-91e3-48e2-9bfb-cc6e846556ea tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:01.813665 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-81125959-91e3-48e2-9bfb-cc6e846556ea tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:01.823873 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-81125959-91e3-48e2-9bfb-cc6e846556ea tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.362481 May 25 14:59:01.831750 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 158/332] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:01 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:02.334305 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-45a18902-cf7e-4d6f-8d7d-c9724843ec6d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:02.335709 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-45a18902-cf7e-4d6f-8d7d-c9724843ec6d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:02.338345 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:02.344771 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-45a18902-cf7e-4d6f-8d7d-c9724843ec6d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:02.345215 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-45a18902-cf7e-4d6f-8d7d-c9724843ec6d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:02.346440 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-45a18902-cf7e-4d6f-8d7d-c9724843ec6d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:02.347128 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-45a18902-cf7e-4d6f-8d7d-c9724843ec6d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:02.531148 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-45a18902-cf7e-4d6f-8d7d-c9724843ec6d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:02.545307 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-45a18902-cf7e-4d6f-8d7d-c9724843ec6d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1720 microversion: 2.1 time: 0.215082 May 25 14:59:02.547130 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 175/333] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:02 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1720 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:02.856853 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8ba2d599-6039-4fa9-b0d0-b149ce7c72f4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:02.857467 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-8ba2d599-6039-4fa9-b0d0-b149ce7c72f4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:02.870004 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8ba2d599-6039-4fa9-b0d0-b149ce7c72f4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:02.870504 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8ba2d599-6039-4fa9-b0d0-b149ce7c72f4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:02.871308 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8ba2d599-6039-4fa9-b0d0-b149ce7c72f4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:02.872162 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8ba2d599-6039-4fa9-b0d0-b149ce7c72f4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:03.162678 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-8ba2d599-6039-4fa9-b0d0-b149ce7c72f4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:03.172267 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-8ba2d599-6039-4fa9-b0d0-b149ce7c72f4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.335370 May 25 14:59:03.175424 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 159/334] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:02 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:03.589786 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-95717eb4-73cf-4bf1-81af-2fad991c1504 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:03.593897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-95717eb4-73cf-4bf1-81af-2fad991c1504 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:03.622088 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-95717eb4-73cf-4bf1-81af-2fad991c1504 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:03.622799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-95717eb4-73cf-4bf1-81af-2fad991c1504 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:03.623896 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-95717eb4-73cf-4bf1-81af-2fad991c1504 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:03.624670 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-95717eb4-73cf-4bf1-81af-2fad991c1504 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:03.953470 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-95717eb4-73cf-4bf1-81af-2fad991c1504 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:03.965411 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-95717eb4-73cf-4bf1-81af-2fad991c1504 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1720 microversion: 2.1 time: 0.404867 May 25 14:59:03.967900 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 176/335] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:03 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1720 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:04.190571 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-07f5820e-d33f-4234-b403-b06054cfbb62 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:04.191247 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-07f5820e-d33f-4234-b403-b06054cfbb62 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:04.200323 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-07f5820e-d33f-4234-b403-b06054cfbb62 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:04.201291 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-07f5820e-d33f-4234-b403-b06054cfbb62 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:04.217008 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-07f5820e-d33f-4234-b403-b06054cfbb62 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:04.217944 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-07f5820e-d33f-4234-b403-b06054cfbb62 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:04.643156 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-07f5820e-d33f-4234-b403-b06054cfbb62 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:04.652317 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-07f5820e-d33f-4234-b403-b06054cfbb62 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.465653 May 25 14:59:04.664211 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 160/336] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:04 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:04.984094 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2cb9977d-ca85-41bd-8c6e-5072f925be4b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:04.985458 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2cb9977d-ca85-41bd-8c6e-5072f925be4b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:04.997948 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2cb9977d-ca85-41bd-8c6e-5072f925be4b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:05.003973 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2cb9977d-ca85-41bd-8c6e-5072f925be4b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:05.004901 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2cb9977d-ca85-41bd-8c6e-5072f925be4b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:05.005344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2cb9977d-ca85-41bd-8c6e-5072f925be4b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:05.317417 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2cb9977d-ca85-41bd-8c6e-5072f925be4b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:05.339098 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2cb9977d-ca85-41bd-8c6e-5072f925be4b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1720 microversion: 2.1 time: 0.360002 May 25 14:59:05.339699 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 177/337] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:04 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1720 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:05.677886 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-949cb2e6-be60-4f44-96a9-c241f061dfb4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:05.679629 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-949cb2e6-be60-4f44-96a9-c241f061dfb4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:05.707026 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-949cb2e6-be60-4f44-96a9-c241f061dfb4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:05.707473 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-949cb2e6-be60-4f44-96a9-c241f061dfb4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:05.708464 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-949cb2e6-be60-4f44-96a9-c241f061dfb4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:05.709102 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-949cb2e6-be60-4f44-96a9-c241f061dfb4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:06.155965 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-949cb2e6-be60-4f44-96a9-c241f061dfb4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:06.169629 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-949cb2e6-be60-4f44-96a9-c241f061dfb4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.502206 May 25 14:59:06.171538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 161/338] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:05 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:06.361204 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2bf19c86-df12-4a16-ae7c-a0b378a7a2ba tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:06.362194 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2bf19c86-df12-4a16-ae7c-a0b378a7a2ba tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:06.387071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2bf19c86-df12-4a16-ae7c-a0b378a7a2ba tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:06.387718 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2bf19c86-df12-4a16-ae7c-a0b378a7a2ba tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:06.388553 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2bf19c86-df12-4a16-ae7c-a0b378a7a2ba tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:06.389439 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2bf19c86-df12-4a16-ae7c-a0b378a7a2ba tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:06.702905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2bf19c86-df12-4a16-ae7c-a0b378a7a2ba tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:06.726195 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2bf19c86-df12-4a16-ae7c-a0b378a7a2ba tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1720 microversion: 2.1 time: 0.371166 May 25 14:59:06.726853 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 178/339] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:06 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1720 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:07.188689 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1ba2b64e-4513-48d9-9815-1522249146d0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:07.189337 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1ba2b64e-4513-48d9-9815-1522249146d0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:07.199961 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1ba2b64e-4513-48d9-9815-1522249146d0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:07.200432 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1ba2b64e-4513-48d9-9815-1522249146d0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:07.201304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1ba2b64e-4513-48d9-9815-1522249146d0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:07.201761 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1ba2b64e-4513-48d9-9815-1522249146d0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:07.579879 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1ba2b64e-4513-48d9-9815-1522249146d0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:07.601358 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1ba2b64e-4513-48d9-9815-1522249146d0 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.416721 May 25 14:59:07.602546 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 162/340] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:07 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:07.752532 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-188cee08-8f0c-4955-97cd-ad5cb8b85950 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:07.753121 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-188cee08-8f0c-4955-97cd-ad5cb8b85950 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:07.769795 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-188cee08-8f0c-4955-97cd-ad5cb8b85950 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:07.770305 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-188cee08-8f0c-4955-97cd-ad5cb8b85950 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:07.771185 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-188cee08-8f0c-4955-97cd-ad5cb8b85950 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:07.775653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-188cee08-8f0c-4955-97cd-ad5cb8b85950 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:08.120302 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-188cee08-8f0c-4955-97cd-ad5cb8b85950 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:08.145550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-188cee08-8f0c-4955-97cd-ad5cb8b85950 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1720 microversion: 2.1 time: 0.388794 May 25 14:59:08.145550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 179/341] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:07 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1720 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:08.640019 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1c06e9a2-bdac-4fc9-85dd-2e2e76f678ca tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:08.640958 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1c06e9a2-bdac-4fc9-85dd-2e2e76f678ca tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:08.667404 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1c06e9a2-bdac-4fc9-85dd-2e2e76f678ca tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:08.667857 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1c06e9a2-bdac-4fc9-85dd-2e2e76f678ca tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:08.668642 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1c06e9a2-bdac-4fc9-85dd-2e2e76f678ca tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:08.678360 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1c06e9a2-bdac-4fc9-85dd-2e2e76f678ca tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:09.155987 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2f0b1b02-e861-423a-a8ee-181fd8c5e601 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:09.156687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2f0b1b02-e861-423a-a8ee-181fd8c5e601 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:09.197168 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2f0b1b02-e861-423a-a8ee-181fd8c5e601 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:09.197705 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2f0b1b02-e861-423a-a8ee-181fd8c5e601 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:09.222544 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2f0b1b02-e861-423a-a8ee-181fd8c5e601 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:09.223134 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2f0b1b02-e861-423a-a8ee-181fd8c5e601 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:09.514972 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1c06e9a2-bdac-4fc9-85dd-2e2e76f678ca tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:09.536873 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1c06e9a2-bdac-4fc9-85dd-2e2e76f678ca tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.898132 May 25 14:59:09.537815 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 163/342] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:08 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:09.600960 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2f0b1b02-e861-423a-a8ee-181fd8c5e601 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:09.610321 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2f0b1b02-e861-423a-a8ee-181fd8c5e601 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1720 microversion: 2.1 time: 0.459296 May 25 14:59:09.618640 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 180/343] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:09 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1720 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:10.557872 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-946357d1-44ee-4e0e-b716-863466dd491b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:10.558573 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-946357d1-44ee-4e0e-b716-863466dd491b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:10.572546 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-946357d1-44ee-4e0e-b716-863466dd491b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:10.573043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-946357d1-44ee-4e0e-b716-863466dd491b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:10.574089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-946357d1-44ee-4e0e-b716-863466dd491b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:10.574402 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-946357d1-44ee-4e0e-b716-863466dd491b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:10.640599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-69c4efbf-59e6-4571-9f53-fdbcbc39309a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:10.642534 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-69c4efbf-59e6-4571-9f53-fdbcbc39309a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:10.688275 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-69c4efbf-59e6-4571-9f53-fdbcbc39309a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:10.688826 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-69c4efbf-59e6-4571-9f53-fdbcbc39309a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:10.695928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-69c4efbf-59e6-4571-9f53-fdbcbc39309a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:10.696491 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-69c4efbf-59e6-4571-9f53-fdbcbc39309a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:11.044320 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-69c4efbf-59e6-4571-9f53-fdbcbc39309a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:11.065030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-69c4efbf-59e6-4571-9f53-fdbcbc39309a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1720 microversion: 2.1 time: 0.438601 May 25 14:59:11.080201 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 181/344] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:10 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1720 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:11.271651 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-946357d1-44ee-4e0e-b716-863466dd491b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:11.284031 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-946357d1-44ee-4e0e-b716-863466dd491b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.731887 May 25 14:59:11.284627 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 164/345] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:10 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:11.454887 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-7bb44643-ce48-4f20-aa7f-0a1dbe587d53 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Action: 'create', calling method: .version_select at 0x7fb1e01779d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1398894099", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGXKikjlAsOlMxlqDAgul5ZXpx1h/p9c06hNT8xEWSuISjfJl+967NTNILmqPrJ8CK5aXn6VZkcWGeQ+xYDp3yIYduQJXZd+PJc67+Skeno0EH3TRcvhkRF0GG2lxw1qw=="}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:11.509446 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-7bb44643-ce48-4f20-aa7f-0a1dbe587d53 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Getting quotas for project 99281bdc8f6340a1be03774c255ae4ba. Resources: {'key_pairs'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:59:11.530474 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-7bb44643-ce48-4f20-aa7f-0a1dbe587d53 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Getting quotas for user daec78050ee547699910603eff8cb7ca and project 99281bdc8f6340a1be03774c255ae4ba. Resources: {'key_pairs'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:59:11.575345 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-7bb44643-ce48-4f20-aa7f-0a1dbe587d53 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.492423 May 25 14:59:11.576220 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 182/346] 10.222.0.78 () {60 vars in 1158 bytes} [Wed May 25 14:59:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:12.083783 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-166e7366-b1e2-4921-86a1-be8471eedb04 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:12.084655 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-166e7366-b1e2-4921-86a1-be8471eedb04 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:12.095717 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-166e7366-b1e2-4921-86a1-be8471eedb04 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:12.097467 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-166e7366-b1e2-4921-86a1-be8471eedb04 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:12.098573 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-166e7366-b1e2-4921-86a1-be8471eedb04 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:12.098851 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-166e7366-b1e2-4921-86a1-be8471eedb04 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:12.309517 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2f227479-6d72-4547-b89b-cbefaac10ab8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:12.312512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2f227479-6d72-4547-b89b-cbefaac10ab8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:12.341043 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2f227479-6d72-4547-b89b-cbefaac10ab8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:12.341835 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2f227479-6d72-4547-b89b-cbefaac10ab8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:12.343753 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2f227479-6d72-4547-b89b-cbefaac10ab8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:12.344445 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2f227479-6d72-4547-b89b-cbefaac10ab8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:12.373323 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-166e7366-b1e2-4921-86a1-be8471eedb04 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:12.404323 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-166e7366-b1e2-4921-86a1-be8471eedb04 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1720 microversion: 2.1 time: 0.324647 May 25 14:59:12.410916 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 165/347] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:12 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1720 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:12.599328 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2f227479-6d72-4547-b89b-cbefaac10ab8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:12.610159 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2f227479-6d72-4547-b89b-cbefaac10ab8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.310812 May 25 14:59:12.610748 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 183/348] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:12 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:13.436121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-3fea6f65-850a-449f-9896-ec63c3c55721 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:13.437908 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-3fea6f65-850a-449f-9896-ec63c3c55721 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:13.461011 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3fea6f65-850a-449f-9896-ec63c3c55721 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:13.461570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3fea6f65-850a-449f-9896-ec63c3c55721 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:13.462791 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3fea6f65-850a-449f-9896-ec63c3c55721 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:13.463248 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3fea6f65-850a-449f-9896-ec63c3c55721 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:13.629453 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3c020103-e2b6-4090-8fa9-0c665c4b5b05 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:13.630368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-3c020103-e2b6-4090-8fa9-0c665c4b5b05 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:13.645033 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3c020103-e2b6-4090-8fa9-0c665c4b5b05 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:13.645859 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3c020103-e2b6-4090-8fa9-0c665c4b5b05 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:13.649044 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3c020103-e2b6-4090-8fa9-0c665c4b5b05 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:13.649559 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3c020103-e2b6-4090-8fa9-0c665c4b5b05 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:13.754262 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3fea6f65-850a-449f-9896-ec63c3c55721 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:13.782375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-3fea6f65-850a-449f-9896-ec63c3c55721 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1720 microversion: 2.1 time: 0.353225 May 25 14:59:13.786639 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 166/349] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:13 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1720 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:13.924679 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-3c020103-e2b6-4090-8fa9-0c665c4b5b05 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:13.943258 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3c020103-e2b6-4090-8fa9-0c665c4b5b05 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.317961 May 25 14:59:13.944005 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 184/350] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:13 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:14.807835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-9e947cf6-9dac-41d3-9875-e69755b742a9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:14.810523 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-9e947cf6-9dac-41d3-9875-e69755b742a9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:14.828523 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9e947cf6-9dac-41d3-9875-e69755b742a9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:14.828978 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9e947cf6-9dac-41d3-9875-e69755b742a9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:14.829754 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9e947cf6-9dac-41d3-9875-e69755b742a9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:14.830221 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9e947cf6-9dac-41d3-9875-e69755b742a9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:14.968272 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-22964b06-3f06-4e82-a41b-440f684a70d4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:14.969914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-22964b06-3f06-4e82-a41b-440f684a70d4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:14.978653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-22964b06-3f06-4e82-a41b-440f684a70d4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:14.981993 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-22964b06-3f06-4e82-a41b-440f684a70d4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:14.983451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-22964b06-3f06-4e82-a41b-440f684a70d4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:14.984076 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-22964b06-3f06-4e82-a41b-440f684a70d4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:15.015271 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-9e947cf6-9dac-41d3-9875-e69755b742a9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:15.024802 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-9e947cf6-9dac-41d3-9875-e69755b742a9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1720 microversion: 2.1 time: 0.224739 May 25 14:59:15.026062 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 167/351] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:14 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1720 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:15.157822 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-22964b06-3f06-4e82-a41b-440f684a70d4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:15.173210 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-22964b06-3f06-4e82-a41b-440f684a70d4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1502 microversion: 2.1 time: 0.212872 May 25 14:59:15.174394 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 185/352] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:14 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1502 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:15.191272 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-675d28e4-d727-47bc-bff5-1751a2dec289 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f60f5ea5-774b-4555-b1a8-947ba864229c"}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:15.192462 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-675d28e4-d727-47bc-bff5-1751a2dec289 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:15.200244 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-675d28e4-d727-47bc-bff5-1751a2dec289 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:15.200886 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-675d28e4-d727-47bc-bff5-1751a2dec289 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:15.202236 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-675d28e4-d727-47bc-bff5-1751a2dec289 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:15.202898 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-675d28e4-d727-47bc-bff5-1751a2dec289 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:15.228737 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-675d28e4-d727-47bc-bff5-1751a2dec289 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] HTTP exception thrown: Cannot 'attach_volume' instance 2553a433-8b4b-4f36-b319-50c84e8b3d7c while it is in vm_state rescued May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-675d28e4-d727-47bc-bff5-1751a2dec289 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Request method failure captured: May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: POST /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c/os-volume_attachments HTTP/1.1 May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 74 May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkOQmzSr_Z_HaubRx-8K0J1aivmzZNuHz2evwqGBpOEbVW_8T5qrSA5J06do9eAUOA11aw7skoO4YnbInUibqk41nPye7EGvIZtAObWYp0uJQiTEIBAVIL8lmFYJs7jq459Lvk6nm7QXpTp2CW9MWVgJbxByPFp56Fy8X_ZzDq-0ZWA May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: acd27057280d4bdda5b9a689a1e399ff May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1162490831 May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 14:59:15.230688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 14:59:15.232245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_acd27057280d4bdda5b9a689a1e399ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/acd27057280d4bdda5b9a689a1e399ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/acd27057280d4bdda5b9a689a1e399ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/acd27057280d4bdda5b9a689a1e399ff"}]}] May 25 14:59:15.232245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1162490831 May 25 14:59:15.232245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: acd27057280d4bdda5b9a689a1e399ff May 25 14:59:15.232245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1162490831 May 25 14:59:15.232245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-ServerRescueNegativeTestJSON-1162490831-project May 25 14:59:15.232245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 14:59:15.232245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 14:59:15.232245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: 97011bf8f6d444468fecdde7acfa1020 May 25 14:59:15.232245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1162490831-project May 25 14:59:15.232245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: May 25 14:59:15.232245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {"volumeAttachment": {"volumeId": "f60f5ea5-774b-4555-b1a8-947ba864229c"}} May 25 14:59:15.232245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Cannot 'attach_volume' instance 2553a433-8b4b-4f36-b319-50c84e8b3d7c while it is in vm_state rescued May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'server_id': '2553a433-8b4b-4f36-b319-50c84e8b3d7c', 'body': {'volumeAttachment': {'volumeId': 'f60f5ea5-774b-4555-b1a8-947ba864229c'}}} May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2553a433-8b4b-4f36-b319-50c84e8b3d7c in vm_state rescued. Cannot attach_volume while the instance is in this state. May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:59:15.233149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2553a433-8b4b-4f36-b319-50c84e8b3d7c while it is in vm_state rescued May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:59:15.234516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:59:15.235801 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:59:15.235801 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:59:15.235801 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2553a433-8b4b-4f36-b319-50c84e8b3d7c while it is in vm_state rescued May 25 14:59:15.235801 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 14:59:15.235801 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-675d28e4-d727-47bc-bff5-1751a2dec289 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Returning 409 to user: Cannot 'attach_volume' instance 2553a433-8b4b-4f36-b319-50c84e8b3d7c while it is in vm_state rescued {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:59:15.235801 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-675d28e4-d727-47bc-bff5-1751a2dec289 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "POST /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045121 May 25 14:59:15.235801 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 168/353] 10.222.0.78 () {60 vars in 1322 bytes} [Wed May 25 14:59:15 2022] POST /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 25 14:59:15.242863 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-97798223-3209-4682-8ca8-757d8469c9e3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:15.243417 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-97798223-3209-4682-8ca8-757d8469c9e3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:15.250221 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-97798223-3209-4682-8ca8-757d8469c9e3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:15.250664 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-97798223-3209-4682-8ca8-757d8469c9e3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:15.251438 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-97798223-3209-4682-8ca8-757d8469c9e3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:15.251866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-97798223-3209-4682-8ca8-757d8469c9e3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:15.286246 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=100 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:15.339090 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-97798223-3209-4682-8ca8-757d8469c9e3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "POST /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c/action" status: 202 len: 0 microversion: 2.1 time: 0.101120 May 25 14:59:15.342866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 186/354] 10.222.0.78 () {60 vars in 1277 bytes} [Wed May 25 14:59:15 2022] POST /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 14:59:15.348197 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-9359cab6-4e90-4642-994a-aa237a40ebc2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:15.348900 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-9359cab6-4e90-4642-994a-aa237a40ebc2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:15.355507 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9359cab6-4e90-4642-994a-aa237a40ebc2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:15.356045 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9359cab6-4e90-4642-994a-aa237a40ebc2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:15.357015 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9359cab6-4e90-4642-994a-aa237a40ebc2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:15.357447 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9359cab6-4e90-4642-994a-aa237a40ebc2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:15.510293 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-9359cab6-4e90-4642-994a-aa237a40ebc2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:15.519669 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-9359cab6-4e90-4642-994a-aa237a40ebc2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1510 microversion: 2.1 time: 0.175290 May 25 14:59:15.520923 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 169/355] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:15 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:16.044016 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-c46a8b74-6bda-4079-9f8a-7a3aa4d2133c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:16.044783 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-c46a8b74-6bda-4079-9f8a-7a3aa4d2133c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:16.051197 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c46a8b74-6bda-4079-9f8a-7a3aa4d2133c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:16.051685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c46a8b74-6bda-4079-9f8a-7a3aa4d2133c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:16.052458 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c46a8b74-6bda-4079-9f8a-7a3aa4d2133c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:16.052894 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c46a8b74-6bda-4079-9f8a-7a3aa4d2133c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:16.235717 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-c46a8b74-6bda-4079-9f8a-7a3aa4d2133c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:16.244782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-c46a8b74-6bda-4079-9f8a-7a3aa4d2133c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1720 microversion: 2.1 time: 0.205173 May 25 14:59:16.245385 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 187/356] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:16 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1720 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:16.537952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b65b8227-bc4d-4346-b4e2-4ccb6e420914 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:16.539539 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b65b8227-bc4d-4346-b4e2-4ccb6e420914 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:16.545831 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b65b8227-bc4d-4346-b4e2-4ccb6e420914 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:16.546338 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b65b8227-bc4d-4346-b4e2-4ccb6e420914 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:16.547113 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b65b8227-bc4d-4346-b4e2-4ccb6e420914 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:16.547553 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b65b8227-bc4d-4346-b4e2-4ccb6e420914 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:16.696546 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b65b8227-bc4d-4346-b4e2-4ccb6e420914 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:16.704637 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b65b8227-bc4d-4346-b4e2-4ccb6e420914 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1510 microversion: 2.1 time: 0.170483 May 25 14:59:16.705366 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 170/357] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:16 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:17.028403 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-29083b5b-c272-457d-8e55-9365525f5aea tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Action: 'create', calling method: .version_select at 0x7fb1e00c4820>, body: {"keypair": {"name": "tempest-keypair-244457338", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhsRsK6IVYGxiNZIahEbKzfDMoMMACYwoT4cncB/u4Jeo3fo4zbaKXw2OUSpm3QtNLikol5/YrxHXYMBUljpQN7ZiWFzaDjGFp1qvf2GtPvyvAhUMN0pCMtSktdvhzW9g=="}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:17.044695 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-29083b5b-c272-457d-8e55-9365525f5aea tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Getting quotas for project 9dafcd0df8524413b4fe81a0931323b1. Resources: {'key_pairs'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:59:17.048969 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-29083b5b-c272-457d-8e55-9365525f5aea tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Getting quotas for user e60a5e751f22450c8e366c85b37af1f6 and project 9dafcd0df8524413b4fe81a0931323b1. Resources: {'key_pairs'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:59:17.099727 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-29083b5b-c272-457d-8e55-9365525f5aea tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.084655 May 25 14:59:17.101651 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 188/358] 10.222.0.78 () {60 vars in 1158 bytes} [Wed May 25 14:59:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:17.264689 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1ec37e5f-7c15-429a-babe-76bfccbeb4c6 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:17.265290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1ec37e5f-7c15-429a-babe-76bfccbeb4c6 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:17.275775 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1ec37e5f-7c15-429a-babe-76bfccbeb4c6 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:17.276220 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1ec37e5f-7c15-429a-babe-76bfccbeb4c6 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:17.276990 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1ec37e5f-7c15-429a-babe-76bfccbeb4c6 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:17.277425 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1ec37e5f-7c15-429a-babe-76bfccbeb4c6 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:17.486224 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1ec37e5f-7c15-429a-babe-76bfccbeb4c6 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:17.495496 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1ec37e5f-7c15-429a-babe-76bfccbeb4c6 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1720 microversion: 2.1 time: 0.236465 May 25 14:59:17.502190 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 171/359] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:17 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1720 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:17.722650 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e0b7cde3-5239-4c98-ab61-66e49f3edbb6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:17.723493 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e0b7cde3-5239-4c98-ab61-66e49f3edbb6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:17.730182 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e0b7cde3-5239-4c98-ab61-66e49f3edbb6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:17.730631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e0b7cde3-5239-4c98-ab61-66e49f3edbb6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:17.731408 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e0b7cde3-5239-4c98-ab61-66e49f3edbb6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:17.731842 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e0b7cde3-5239-4c98-ab61-66e49f3edbb6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:17.877609 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e0b7cde3-5239-4c98-ab61-66e49f3edbb6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:17.886429 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e0b7cde3-5239-4c98-ab61-66e49f3edbb6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1510 microversion: 2.1 time: 0.167383 May 25 14:59:17.887011 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 189/360] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:17 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:18.514949 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-808c7968-491d-4a5b-a635-45a5d020677c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:18.516326 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-808c7968-491d-4a5b-a635-45a5d020677c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:18.524936 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-808c7968-491d-4a5b-a635-45a5d020677c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:18.525581 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-808c7968-491d-4a5b-a635-45a5d020677c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:18.526764 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-808c7968-491d-4a5b-a635-45a5d020677c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:18.527211 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-808c7968-491d-4a5b-a635-45a5d020677c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:18.700707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-96e89dda-aadc-4090-9012-97ddb5aa759e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2059973406", "imageRef": "fbec7c78-0103-4632-9a21-d8e8056f2ce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c4b07fe-140a-4a0b-9f8f-030d2bf81125"}], "security_groups": [{"name": "tempest-securitygroup--13916965"}], "key_name": "tempest-keypair-244457338", "user_data": "}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:18.718723 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-808c7968-491d-4a5b-a635-45a5d020677c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:18.728139 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-808c7968-491d-4a5b-a635-45a5d020677c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1720 microversion: 2.1 time: 0.218562 May 25 14:59:18.728715 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 172/361] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:18 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:18.906402 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2cc7fec5-a75e-4b9c-ac7d-c2a9a7a48f99 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:18.907020 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2cc7fec5-a75e-4b9c-ac7d-c2a9a7a48f99 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:18.918863 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2cc7fec5-a75e-4b9c-ac7d-c2a9a7a48f99 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:18.919317 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2cc7fec5-a75e-4b9c-ac7d-c2a9a7a48f99 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:18.920120 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2cc7fec5-a75e-4b9c-ac7d-c2a9a7a48f99 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:18.920560 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2cc7fec5-a75e-4b9c-ac7d-c2a9a7a48f99 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:18.925159 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=100 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:19.102849 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-2cc7fec5-a75e-4b9c-ac7d-c2a9a7a48f99 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:19.114505 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2cc7fec5-a75e-4b9c-ac7d-c2a9a7a48f99 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1510 microversion: 2.1 time: 0.211905 May 25 14:59:19.115077 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 173/362] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:18 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1510 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:19.745754 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-5679b8c0-c69c-4c95-b1d1-32457cd76d7f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:19.746446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-5679b8c0-c69c-4c95-b1d1-32457cd76d7f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:19.754176 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5679b8c0-c69c-4c95-b1d1-32457cd76d7f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:19.754635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5679b8c0-c69c-4c95-b1d1-32457cd76d7f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:19.755430 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5679b8c0-c69c-4c95-b1d1-32457cd76d7f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:19.755867 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5679b8c0-c69c-4c95-b1d1-32457cd76d7f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:19.963569 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-5679b8c0-c69c-4c95-b1d1-32457cd76d7f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:19.973142 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-5679b8c0-c69c-4c95-b1d1-32457cd76d7f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1720 microversion: 2.1 time: 0.231011 May 25 14:59:19.973928 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 174/363] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:19 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1720 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:20.133390 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-04b11b9a-b9d6-477f-9fda-82326f063c31 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:20.134182 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-04b11b9a-b9d6-477f-9fda-82326f063c31 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:20.142324 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-04b11b9a-b9d6-477f-9fda-82326f063c31 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:20.142949 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-04b11b9a-b9d6-477f-9fda-82326f063c31 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:20.143789 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-04b11b9a-b9d6-477f-9fda-82326f063c31 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:20.144639 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-04b11b9a-b9d6-477f-9fda-82326f063c31 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:20.315836 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-04b11b9a-b9d6-477f-9fda-82326f063c31 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:20.328805 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-04b11b9a-b9d6-477f-9fda-82326f063c31 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1516 microversion: 2.1 time: 0.199910 May 25 14:59:20.329392 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 175/364] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:20 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1516 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:20.992806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-73ce8056-14a0-4df6-9f75-6c1d80c61086 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:20.994234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-73ce8056-14a0-4df6-9f75-6c1d80c61086 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:21.003295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-73ce8056-14a0-4df6-9f75-6c1d80c61086 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:21.003978 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-73ce8056-14a0-4df6-9f75-6c1d80c61086 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:21.005184 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-73ce8056-14a0-4df6-9f75-6c1d80c61086 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:21.005979 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-73ce8056-14a0-4df6-9f75-6c1d80c61086 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:21.149343 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-73ce8056-14a0-4df6-9f75-6c1d80c61086 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:21.158795 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-73ce8056-14a0-4df6-9f75-6c1d80c61086 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1697 microversion: 2.1 time: 0.170361 May 25 14:59:21.159601 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 176/365] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:20 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:21.178076 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6ce08208-fb57-45dc-becc-a50b2e66756d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:21.186078 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6ce08208-fb57-45dc-becc-a50b2e66756d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:21.186676 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6ce08208-fb57-45dc-becc-a50b2e66756d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:21.216155 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6ce08208-fb57-45dc-becc-a50b2e66756d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Going to try to start instance {{(pid=124524) start /opt/stack/nova/nova/compute/api.py:2730}} May 25 14:59:21.266933 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6ce08208-fb57-45dc-becc-a50b2e66756d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "POST /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912/action" status: 202 len: 0 microversion: 2.1 time: 0.092558 May 25 14:59:21.266933 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 177/366] 10.222.0.78 () {60 vars in 1277 bytes} [Wed May 25 14:59:21 2022] POST /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 14:59:21.278406 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d6fd649f-9411-449b-9f26-7a9d35c4232c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:21.279271 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d6fd649f-9411-449b-9f26-7a9d35c4232c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:21.287071 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d6fd649f-9411-449b-9f26-7a9d35c4232c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:21.287700 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d6fd649f-9411-449b-9f26-7a9d35c4232c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:21.290128 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d6fd649f-9411-449b-9f26-7a9d35c4232c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:21.290732 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d6fd649f-9411-449b-9f26-7a9d35c4232c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:21.464039 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d6fd649f-9411-449b-9f26-7a9d35c4232c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:21.472708 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d6fd649f-9411-449b-9f26-7a9d35c4232c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1706 microversion: 2.1 time: 0.200372 May 25 14:59:21.473300 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 178/367] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:21 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1706 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:21.828097 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-64dfc1a8-305e-4ff4-bf06-d2ecce7c4c0b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Action: 'create', calling method: .version_select at 0x7fb1db7e4a60>, body: {"keypair": {"name": "tempest-keypair-655743168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwG9uusN40k5o78cfuffGH31dsE7FrYLRzIlznsxLMa4Qb/my9xPJ8ua+aFRkKLsAMFQUYzxw+QV3TXHEP4EzhDK8c8NOnAGW9vF/C46GeffRJGOsGwGcu3oryXw77uwA=="}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:21.847736 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-64dfc1a8-305e-4ff4-bf06-d2ecce7c4c0b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Getting quotas for project acd27057280d4bdda5b9a689a1e399ff. Resources: {'key_pairs'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:59:21.852411 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-64dfc1a8-305e-4ff4-bf06-d2ecce7c4c0b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Getting quotas for user 97011bf8f6d444468fecdde7acfa1020 and project acd27057280d4bdda5b9a689a1e399ff. Resources: {'key_pairs'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:59:21.893799 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-64dfc1a8-305e-4ff4-bf06-d2ecce7c4c0b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.071007 May 25 14:59:21.894446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 179/368] 10.222.0.78 () {60 vars in 1158 bytes} [Wed May 25 14:59:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:59:22.492129 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8e178d81-9619-4be8-9c4e-3933a069b9ae tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:22.492833 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-8e178d81-9619-4be8-9c4e-3933a069b9ae tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:22.499272 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8e178d81-9619-4be8-9c4e-3933a069b9ae tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:22.499714 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8e178d81-9619-4be8-9c4e-3933a069b9ae tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:22.500493 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8e178d81-9619-4be8-9c4e-3933a069b9ae tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:22.500961 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8e178d81-9619-4be8-9c4e-3933a069b9ae tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:22.724876 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-8e178d81-9619-4be8-9c4e-3933a069b9ae tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:22.734089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-8e178d81-9619-4be8-9c4e-3933a069b9ae tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1706 microversion: 2.1 time: 0.247012 May 25 14:59:22.734826 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 180/369] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:22 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1706 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:23.390256 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-f40231fc-6c7f-422b-9ff6-85acda4c4c09 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-56430705", "imageRef": "fbec7c78-0103-4632-9a21-d8e8056f2ce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e385260d-6c1a-4502-b416-70a643ca9f7a"}], "security_groups": [{"name": "tempest-securitygroup--718009281"}], "key_name": "tempest-keypair-655743168", "user_data": "}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:25.159762 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.network.neutron [None req-96e89dda-aadc-4090-9012-97ddb5aa759e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] validate_networks() for [('6c4b07fe-140a-4a0b-9f8f-030d2bf81125', None, None, None, None, None)] {{(pid=124523) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:59:25.167177 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.network.neutron [None req-f40231fc-6c7f-422b-9ff6-85acda4c4c09 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] validate_networks() for [('e385260d-6c1a-4502-b416-70a643ca9f7a', None, None, None, None, None)] {{(pid=124524) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:59:25.571242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-96e89dda-aadc-4090-9012-97ddb5aa759e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Flavor limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:59:25.571740 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-96e89dda-aadc-4090-9012-97ddb5aa759e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Image limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:59:25.572212 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-96e89dda-aadc-4090-9012-97ddb5aa759e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Flavor pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:59:25.572613 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-96e89dda-aadc-4090-9012-97ddb5aa759e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Image pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:59:25.573018 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-96e89dda-aadc-4090-9012-97ddb5aa759e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:59:25.582766 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-96e89dda-aadc-4090-9012-97ddb5aa759e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:25.583441 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-96e89dda-aadc-4090-9012-97ddb5aa759e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:25.584398 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-96e89dda-aadc-4090-9012-97ddb5aa759e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:25.584829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-96e89dda-aadc-4090-9012-97ddb5aa759e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:25.585448 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-f40231fc-6c7f-422b-9ff6-85acda4c4c09 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Flavor limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:59:25.585872 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-f40231fc-6c7f-422b-9ff6-85acda4c4c09 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Image limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:59:25.586375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-f40231fc-6c7f-422b-9ff6-85acda4c4c09 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Flavor pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:59:25.586800 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-f40231fc-6c7f-422b-9ff6-85acda4c4c09 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Image pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:59:25.587209 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-f40231fc-6c7f-422b-9ff6-85acda4c4c09 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:59:25.607883 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f40231fc-6c7f-422b-9ff6-85acda4c4c09 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:25.609987 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f40231fc-6c7f-422b-9ff6-85acda4c4c09 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:25.611587 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f40231fc-6c7f-422b-9ff6-85acda4c4c09 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:25.612060 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-96e89dda-aadc-4090-9012-97ddb5aa759e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Getting quotas for project 9dafcd0df8524413b4fe81a0931323b1. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:59:25.612751 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f40231fc-6c7f-422b-9ff6-85acda4c4c09 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:25.623320 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-96e89dda-aadc-4090-9012-97ddb5aa759e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Getting quotas for user e60a5e751f22450c8e366c85b37af1f6 and project 9dafcd0df8524413b4fe81a0931323b1. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:59:25.636583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-96e89dda-aadc-4090-9012-97ddb5aa759e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Going to run 1 instances... {{(pid=124523) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:59:25.638202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-f40231fc-6c7f-422b-9ff6-85acda4c4c09 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Getting quotas for project acd27057280d4bdda5b9a689a1e399ff. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:59:25.639212 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-96e89dda-aadc-4090-9012-97ddb5aa759e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbec7c78-0103-4632-9a21-d8e8056f2ce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:59:25.642993 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-f40231fc-6c7f-422b-9ff6-85acda4c4c09 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Getting quotas for user 97011bf8f6d444468fecdde7acfa1020 and project acd27057280d4bdda5b9a689a1e399ff. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:59:25.655347 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-f40231fc-6c7f-422b-9ff6-85acda4c4c09 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Going to run 1 instances... {{(pid=124524) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:59:25.657990 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-f40231fc-6c7f-422b-9ff6-85acda4c4c09 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbec7c78-0103-4632-9a21-d8e8056f2ce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:59:25.691256 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-96e89dda-aadc-4090-9012-97ddb5aa759e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 6.994676 May 25 14:59:25.696762 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 190/370] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 14:59:18 2022] POST /compute/v2.1/servers => generated 400 bytes in 6996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 14:59:25.700794 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-014bc8b6-4daa-4962-9120-76be82e967d5 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:25.701406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-014bc8b6-4daa-4962-9120-76be82e967d5 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:25.704159 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f40231fc-6c7f-422b-9ff6-85acda4c4c09 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [05365cf6-d18f-430b-a7e7-fc962f4d0efc] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 25 14:59:25.707952 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-014bc8b6-4daa-4962-9120-76be82e967d5 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:25.708407 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-014bc8b6-4daa-4962-9120-76be82e967d5 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:25.709185 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-014bc8b6-4daa-4962-9120-76be82e967d5 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:25.709628 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-014bc8b6-4daa-4962-9120-76be82e967d5 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:25.842749 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-014bc8b6-4daa-4962-9120-76be82e967d5 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:25.851437 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-014bc8b6-4daa-4962-9120-76be82e967d5 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1710 microversion: 2.1 time: 0.157402 May 25 14:59:25.852126 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 191/371] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:25 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1710 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:25.856572 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f60ba225-52dc-42af-949c-274c9edc9718 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:25.857177 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f60ba225-52dc-42af-949c-274c9edc9718 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:25.911563 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f60ba225-52dc-42af-949c-274c9edc9718 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:25.918929 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f60ba225-52dc-42af-949c-274c9edc9718 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1241 microversion: 2.1 time: 0.065966 May 25 14:59:25.919487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 192/372] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:25 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:26.713672 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO oslo.messaging._drivers.impl_rabbit [None req-f40231fc-6c7f-422b-9ff6-85acda4c4c09 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [05365cf6-d18f-430b-a7e7-fc962f4d0efc] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 53274. May 25 14:59:26.717852 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-f40231fc-6c7f-422b-9ff6-85acda4c4c09 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.332260 May 25 14:59:26.718608 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 181/373] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 14:59:23 2022] POST /compute/v2.1/servers => generated 408 bytes in 3334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 14:59:26.728684 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-113cb1df-1a41-41b7-8038-775a7db34886 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:26.729361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-113cb1df-1a41-41b7-8038-775a7db34886 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:26.802521 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-113cb1df-1a41-41b7-8038-775a7db34886 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:26.811552 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-113cb1df-1a41-41b7-8038-775a7db34886 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1243 microversion: 2.1 time: 0.086824 May 25 14:59:26.819252 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 193/374] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:26 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1243 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:26.946553 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-91d319e7-c383-409b-8c67-c47917cad5d8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:26.947203 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-91d319e7-c383-409b-8c67-c47917cad5d8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:27.012615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-91d319e7-c383-409b-8c67-c47917cad5d8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:27.020199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-91d319e7-c383-409b-8c67-c47917cad5d8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1241 microversion: 2.1 time: 0.079329 May 25 14:59:27.020796 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 182/375] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:26 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:27.828323 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-952450a3-f9d5-4539-874c-a5468ca97a40 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:27.828936 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-952450a3-f9d5-4539-874c-a5468ca97a40 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:27.835463 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-952450a3-f9d5-4539-874c-a5468ca97a40 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:27.835922 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-952450a3-f9d5-4539-874c-a5468ca97a40 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:27.836710 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-952450a3-f9d5-4539-874c-a5468ca97a40 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:27.837667 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-952450a3-f9d5-4539-874c-a5468ca97a40 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:27.916177 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-952450a3-f9d5-4539-874c-a5468ca97a40 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:27.924715 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-952450a3-f9d5-4539-874c-a5468ca97a40 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1295 microversion: 2.1 time: 0.100291 May 25 14:59:27.931560 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 194/376] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:27 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1295 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:28.037488 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d8be575a-3dc1-4f39-a431-b804a0c079e6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:28.038350 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d8be575a-3dc1-4f39-a431-b804a0c079e6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:28.040811 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:28.098092 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d8be575a-3dc1-4f39-a431-b804a0c079e6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:28.104986 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d8be575a-3dc1-4f39-a431-b804a0c079e6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1241 microversion: 2.1 time: 0.071404 May 25 14:59:28.105567 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 183/377] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:28 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:28.942457 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e26a4687-184f-4bc8-9600-6ef766f4950f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:28.943148 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e26a4687-184f-4bc8-9600-6ef766f4950f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:28.951572 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e26a4687-184f-4bc8-9600-6ef766f4950f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:28.952022 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e26a4687-184f-4bc8-9600-6ef766f4950f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:28.952805 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e26a4687-184f-4bc8-9600-6ef766f4950f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:28.953251 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e26a4687-184f-4bc8-9600-6ef766f4950f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:29.034552 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e26a4687-184f-4bc8-9600-6ef766f4950f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:29.043196 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e26a4687-184f-4bc8-9600-6ef766f4950f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1301 microversion: 2.1 time: 0.104491 May 25 14:59:29.044132 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 195/378] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:28 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1301 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:29.122912 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-83ecd8f3-0c54-4166-b1bd-645ed61254ca tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:29.124244 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-83ecd8f3-0c54-4166-b1bd-645ed61254ca tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:29.203409 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-83ecd8f3-0c54-4166-b1bd-645ed61254ca tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:29.212062 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-83ecd8f3-0c54-4166-b1bd-645ed61254ca tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1241 microversion: 2.1 time: 0.093178 May 25 14:59:29.212875 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 184/379] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:29 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:30.060751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3268f2b2-bf86-4b22-8ec6-39a67b85a38e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:30.061559 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-3268f2b2-bf86-4b22-8ec6-39a67b85a38e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:30.068008 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3268f2b2-bf86-4b22-8ec6-39a67b85a38e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:30.068562 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3268f2b2-bf86-4b22-8ec6-39a67b85a38e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:30.069902 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3268f2b2-bf86-4b22-8ec6-39a67b85a38e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:30.070898 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3268f2b2-bf86-4b22-8ec6-39a67b85a38e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:30.230931 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b4e497cb-ab6b-45fb-b6d8-0c0713d456e0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:30.232194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b4e497cb-ab6b-45fb-b6d8-0c0713d456e0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:30.248357 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b4e497cb-ab6b-45fb-b6d8-0c0713d456e0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:30.248915 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b4e497cb-ab6b-45fb-b6d8-0c0713d456e0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:30.249829 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b4e497cb-ab6b-45fb-b6d8-0c0713d456e0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:30.250361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b4e497cb-ab6b-45fb-b6d8-0c0713d456e0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:30.329722 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-3268f2b2-bf86-4b22-8ec6-39a67b85a38e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:30.338746 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3268f2b2-bf86-4b22-8ec6-39a67b85a38e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1368 microversion: 2.1 time: 0.281717 May 25 14:59:30.342911 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 196/380] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:30 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1368 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:30.359137 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b4e497cb-ab6b-45fb-b6d8-0c0713d456e0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:30.391814 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b4e497cb-ab6b-45fb-b6d8-0c0713d456e0 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1245 microversion: 2.1 time: 0.164195 May 25 14:59:30.393075 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 185/381] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:30 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1245 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:30.555797 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-bec7b917-b8ee-417b-8841-9f62b3ac13da req-139761b1-5285-4675-968c-98d692da030b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58a68392-711b-4106-990e-f6ad82525d59", "tag": "219ede9e-3779-4194-a09a-08090b45e691"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:30.573231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-bec7b917-b8ee-417b-8841-9f62b3ac13da req-139761b1-5285-4675-968c-98d692da030b service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:30.574397 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-bec7b917-b8ee-417b-8841-9f62b3ac13da req-139761b1-5285-4675-968c-98d692da030b service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:30.589274 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-bec7b917-b8ee-417b-8841-9f62b3ac13da req-139761b1-5285-4675-968c-98d692da030b service nova] Creating event network-changed:219ede9e-3779-4194-a09a-08090b45e691 for instance 58a68392-711b-4106-990e-f6ad82525d59 on hv-cinder-80382 May 25 14:59:30.596793 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-bec7b917-b8ee-417b-8841-9f62b3ac13da req-139761b1-5285-4675-968c-98d692da030b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045495 May 25 14:59:30.598024 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 197/382] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:59:31.359534 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-4ff4f0c4-00a7-45a7-abb4-57be06d3c847 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:31.360145 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-4ff4f0c4-00a7-45a7-abb4-57be06d3c847 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:31.367738 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4ff4f0c4-00a7-45a7-abb4-57be06d3c847 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:31.368191 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4ff4f0c4-00a7-45a7-abb4-57be06d3c847 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:31.368975 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4ff4f0c4-00a7-45a7-abb4-57be06d3c847 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:31.369420 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4ff4f0c4-00a7-45a7-abb4-57be06d3c847 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:31.412099 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e79a3511-849a-417c-bf8c-ee1b2439f34a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:31.413827 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e79a3511-849a-417c-bf8c-ee1b2439f34a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:31.421247 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e79a3511-849a-417c-bf8c-ee1b2439f34a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:31.421704 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e79a3511-849a-417c-bf8c-ee1b2439f34a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:31.422690 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e79a3511-849a-417c-bf8c-ee1b2439f34a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:31.423147 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e79a3511-849a-417c-bf8c-ee1b2439f34a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:31.524539 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e79a3511-849a-417c-bf8c-ee1b2439f34a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:31.536251 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e79a3511-849a-417c-bf8c-ee1b2439f34a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1301 microversion: 2.1 time: 0.128965 May 25 14:59:31.537506 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 198/383] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:31 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1301 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:31.617684 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-4ff4f0c4-00a7-45a7-abb4-57be06d3c847 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:31.627217 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-4ff4f0c4-00a7-45a7-abb4-57be06d3c847 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1368 microversion: 2.1 time: 0.271672 May 25 14:59:31.628263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 186/384] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:31 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1368 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:32.554891 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-c149ab02-806e-4c2d-a754-5ae4576e0af7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:32.555598 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-c149ab02-806e-4c2d-a754-5ae4576e0af7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:32.557619 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:32.564619 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c149ab02-806e-4c2d-a754-5ae4576e0af7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:32.565042 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c149ab02-806e-4c2d-a754-5ae4576e0af7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:32.566268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c149ab02-806e-4c2d-a754-5ae4576e0af7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:32.566882 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c149ab02-806e-4c2d-a754-5ae4576e0af7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:32.646454 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2df484ea-f069-4060-a223-901dcfd3c5c2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:32.647823 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2df484ea-f069-4060-a223-901dcfd3c5c2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:32.654144 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2df484ea-f069-4060-a223-901dcfd3c5c2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:32.654545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2df484ea-f069-4060-a223-901dcfd3c5c2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:32.655333 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2df484ea-f069-4060-a223-901dcfd3c5c2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:32.655843 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2df484ea-f069-4060-a223-901dcfd3c5c2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:32.724960 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-c149ab02-806e-4c2d-a754-5ae4576e0af7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:32.733428 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-c149ab02-806e-4c2d-a754-5ae4576e0af7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1365 microversion: 2.1 time: 0.183278 May 25 14:59:32.734155 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 199/385] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:32 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:32.814604 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-2df484ea-f069-4060-a223-901dcfd3c5c2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:32.822989 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2df484ea-f069-4060-a223-901dcfd3c5c2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1368 microversion: 2.1 time: 0.181454 May 25 14:59:32.823567 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 187/386] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:32 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:33.762465 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e607f994-929b-4488-a095-4639dacf8e24 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:33.763371 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e607f994-929b-4488-a095-4639dacf8e24 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:33.769462 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e607f994-929b-4488-a095-4639dacf8e24 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:33.769921 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e607f994-929b-4488-a095-4639dacf8e24 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:33.770723 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e607f994-929b-4488-a095-4639dacf8e24 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:33.771166 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e607f994-929b-4488-a095-4639dacf8e24 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:33.841275 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-03706112-99d0-41a5-9aea-cecd0874a8cb tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:33.842034 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-03706112-99d0-41a5-9aea-cecd0874a8cb tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:33.848819 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-03706112-99d0-41a5-9aea-cecd0874a8cb tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:33.849273 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-03706112-99d0-41a5-9aea-cecd0874a8cb tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:33.850076 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-03706112-99d0-41a5-9aea-cecd0874a8cb tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:33.850648 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-03706112-99d0-41a5-9aea-cecd0874a8cb tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:33.941541 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e607f994-929b-4488-a095-4639dacf8e24 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:33.951055 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e607f994-929b-4488-a095-4639dacf8e24 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1365 microversion: 2.1 time: 0.192362 May 25 14:59:33.951757 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 200/387] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:33 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:34.003867 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-03706112-99d0-41a5-9aea-cecd0874a8cb tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:34.013224 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-03706112-99d0-41a5-9aea-cecd0874a8cb tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1368 microversion: 2.1 time: 0.176446 May 25 14:59:34.014123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 188/388] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:33 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:34.968496 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-93cae8f3-4ad1-4e81-82b2-7a2c5ecee8bb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:34.969146 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-93cae8f3-4ad1-4e81-82b2-7a2c5ecee8bb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:34.976213 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-93cae8f3-4ad1-4e81-82b2-7a2c5ecee8bb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:34.976658 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-93cae8f3-4ad1-4e81-82b2-7a2c5ecee8bb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:34.977534 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-93cae8f3-4ad1-4e81-82b2-7a2c5ecee8bb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:34.978019 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-93cae8f3-4ad1-4e81-82b2-7a2c5ecee8bb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:35.030836 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a22c2963-1be5-46b2-924d-0ddb21f711e7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:35.031663 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-a22c2963-1be5-46b2-924d-0ddb21f711e7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:35.041139 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a22c2963-1be5-46b2-924d-0ddb21f711e7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:35.041684 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a22c2963-1be5-46b2-924d-0ddb21f711e7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:35.042529 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a22c2963-1be5-46b2-924d-0ddb21f711e7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:35.042970 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a22c2963-1be5-46b2-924d-0ddb21f711e7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:35.126673 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-93cae8f3-4ad1-4e81-82b2-7a2c5ecee8bb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:35.135069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-93cae8f3-4ad1-4e81-82b2-7a2c5ecee8bb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1365 microversion: 2.1 time: 0.170499 May 25 14:59:35.135736 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 201/389] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:34 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:35.188468 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-a22c2963-1be5-46b2-924d-0ddb21f711e7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:35.196311 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-a22c2963-1be5-46b2-924d-0ddb21f711e7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1368 microversion: 2.1 time: 0.169247 May 25 14:59:35.196890 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 189/390] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:35 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:36.153692 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a702cfd5-e299-473f-9fb2-a91579dc9d15 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:36.154800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a702cfd5-e299-473f-9fb2-a91579dc9d15 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:36.157485 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=2 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:36.165081 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a702cfd5-e299-473f-9fb2-a91579dc9d15 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:36.165532 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a702cfd5-e299-473f-9fb2-a91579dc9d15 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:36.166350 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a702cfd5-e299-473f-9fb2-a91579dc9d15 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:36.166785 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a702cfd5-e299-473f-9fb2-a91579dc9d15 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:36.214648 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6ea218b1-5f7a-4683-9f42-b5459ec7d00e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:36.215555 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6ea218b1-5f7a-4683-9f42-b5459ec7d00e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:36.217567 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:36.223533 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6ea218b1-5f7a-4683-9f42-b5459ec7d00e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:36.224067 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6ea218b1-5f7a-4683-9f42-b5459ec7d00e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:36.224847 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6ea218b1-5f7a-4683-9f42-b5459ec7d00e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:36.225289 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6ea218b1-5f7a-4683-9f42-b5459ec7d00e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:36.303101 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a702cfd5-e299-473f-9fb2-a91579dc9d15 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:36.311930 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a702cfd5-e299-473f-9fb2-a91579dc9d15 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1365 microversion: 2.1 time: 0.162602 May 25 14:59:36.312765 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 202/391] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:36 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:36.356371 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6ea218b1-5f7a-4683-9f42-b5459ec7d00e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:36.363378 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6ea218b1-5f7a-4683-9f42-b5459ec7d00e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1368 microversion: 2.1 time: 0.152794 May 25 14:59:36.363952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 190/392] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:36 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:37.330514 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-9553dc67-b9ef-439b-9731-fe09977f20a4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:37.331679 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-9553dc67-b9ef-439b-9731-fe09977f20a4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:37.334993 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=18 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:37.339088 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9553dc67-b9ef-439b-9731-fe09977f20a4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:37.339531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9553dc67-b9ef-439b-9731-fe09977f20a4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:37.340296 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9553dc67-b9ef-439b-9731-fe09977f20a4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:37.340723 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9553dc67-b9ef-439b-9731-fe09977f20a4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:37.383109 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6fef9bbd-d8e1-43d2-83c2-16af28acd602 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:37.384595 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6fef9bbd-d8e1-43d2-83c2-16af28acd602 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:37.391857 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6fef9bbd-d8e1-43d2-83c2-16af28acd602 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:37.392304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6fef9bbd-d8e1-43d2-83c2-16af28acd602 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:37.393235 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6fef9bbd-d8e1-43d2-83c2-16af28acd602 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:37.393613 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6fef9bbd-d8e1-43d2-83c2-16af28acd602 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:37.698282 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-9553dc67-b9ef-439b-9731-fe09977f20a4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:37.706596 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-9553dc67-b9ef-439b-9731-fe09977f20a4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1365 microversion: 2.1 time: 0.380665 May 25 14:59:37.707304 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 203/393] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:37 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1365 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:37.824432 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6fef9bbd-d8e1-43d2-83c2-16af28acd602 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:37.831995 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6fef9bbd-d8e1-43d2-83c2-16af28acd602 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1368 microversion: 2.1 time: 0.454440 May 25 14:59:37.832566 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 191/394] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:37 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1368 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:38.158265 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-a16dbf8e-f9fe-49e9-8a39-cb51ab20e0f4 req-ca3c4eb9-1410-4849-a9d6-d5bcfe44c5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f150bd82-8a04-4a33-bebd-594f65f1d6a7", "tag": "bedd3cb1-f210-414d-ada2-ad2ffd6d01ae"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:38.169806 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-a16dbf8e-f9fe-49e9-8a39-cb51ab20e0f4 req-ca3c4eb9-1410-4849-a9d6-d5bcfe44c5d5 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:38.170386 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-a16dbf8e-f9fe-49e9-8a39-cb51ab20e0f4 req-ca3c4eb9-1410-4849-a9d6-d5bcfe44c5d5 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:38.188415 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-a16dbf8e-f9fe-49e9-8a39-cb51ab20e0f4 req-ca3c4eb9-1410-4849-a9d6-d5bcfe44c5d5 service nova] Creating event network-changed:bedd3cb1-f210-414d-ada2-ad2ffd6d01ae for instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 on hv-cinder-80382 May 25 14:59:38.195214 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-a16dbf8e-f9fe-49e9-8a39-cb51ab20e0f4 req-ca3c4eb9-1410-4849-a9d6-d5bcfe44c5d5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046140 May 25 14:59:38.195835 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 204/395] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:38.724170 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8a0dea40-6870-4f09-863a-5571741d8f01 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:38.725015 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-8a0dea40-6870-4f09-863a-5571741d8f01 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:38.732171 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8a0dea40-6870-4f09-863a-5571741d8f01 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:38.732636 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8a0dea40-6870-4f09-863a-5571741d8f01 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:38.733407 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8a0dea40-6870-4f09-863a-5571741d8f01 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:38.733864 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8a0dea40-6870-4f09-863a-5571741d8f01 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:38.849406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-79fce7f3-39d9-4514-8170-673d4eba12f3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:38.850147 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-79fce7f3-39d9-4514-8170-673d4eba12f3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:38.857746 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-79fce7f3-39d9-4514-8170-673d4eba12f3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:38.858235 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-79fce7f3-39d9-4514-8170-673d4eba12f3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:38.859054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-79fce7f3-39d9-4514-8170-673d4eba12f3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:38.859498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-79fce7f3-39d9-4514-8170-673d4eba12f3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:38.872328 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-8a0dea40-6870-4f09-863a-5571741d8f01 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:38.879796 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-8a0dea40-6870-4f09-863a-5571741d8f01 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1365 microversion: 2.1 time: 0.159447 May 25 14:59:38.880355 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 192/396] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:38 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:39.009733 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-79fce7f3-39d9-4514-8170-673d4eba12f3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:39.017616 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-79fce7f3-39d9-4514-8170-673d4eba12f3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1368 microversion: 2.1 time: 0.172540 May 25 14:59:39.018215 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 205/397] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:38 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:39.211453 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-815b18da-68cf-4a8d-a0a2-2e98632285ed req-85031fac-d63f-4141-a80a-9d765b5d69af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a68392-711b-4106-990e-f6ad82525d59", "name": "network-vif-plugged", "status": "completed", "tag": "219ede9e-3779-4194-a09a-08090b45e691"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:39.215121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=16 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:39.220977 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-815b18da-68cf-4a8d-a0a2-2e98632285ed req-85031fac-d63f-4141-a80a-9d765b5d69af service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:39.221350 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-815b18da-68cf-4a8d-a0a2-2e98632285ed req-85031fac-d63f-4141-a80a-9d765b5d69af service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:39.239692 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-815b18da-68cf-4a8d-a0a2-2e98632285ed req-85031fac-d63f-4141-a80a-9d765b5d69af service nova] Creating event network-vif-plugged:219ede9e-3779-4194-a09a-08090b45e691 for instance 58a68392-711b-4106-990e-f6ad82525d59 on hv-cinder-80382 May 25 14:59:39.247555 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-815b18da-68cf-4a8d-a0a2-2e98632285ed req-85031fac-d63f-4141-a80a-9d765b5d69af service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040067 May 25 14:59:39.248424 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 193/398] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:39.897402 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-7583ccd4-82af-43fd-8dca-951e3e6b4566 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:39.898163 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-7583ccd4-82af-43fd-8dca-951e3e6b4566 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:39.904337 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7583ccd4-82af-43fd-8dca-951e3e6b4566 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:39.904788 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7583ccd4-82af-43fd-8dca-951e3e6b4566 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:39.905560 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7583ccd4-82af-43fd-8dca-951e3e6b4566 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:39.905998 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7583ccd4-82af-43fd-8dca-951e3e6b4566 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:40.034245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-7583ccd4-82af-43fd-8dca-951e3e6b4566 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:40.036304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-5ed2dbb0-828b-4ab4-87ca-66e8cb7be62c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:40.037010 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-5ed2dbb0-828b-4ab4-87ca-66e8cb7be62c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:40.042483 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-7583ccd4-82af-43fd-8dca-951e3e6b4566 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1365 microversion: 2.1 time: 0.149562 May 25 14:59:40.043074 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 206/399] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:39 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:40.044054 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5ed2dbb0-828b-4ab4-87ca-66e8cb7be62c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:40.044507 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5ed2dbb0-828b-4ab4-87ca-66e8cb7be62c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:40.045287 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5ed2dbb0-828b-4ab4-87ca-66e8cb7be62c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:40.045733 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5ed2dbb0-828b-4ab4-87ca-66e8cb7be62c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:40.049993 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:40.178580 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-5ed2dbb0-828b-4ab4-87ca-66e8cb7be62c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:40.186689 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-5ed2dbb0-828b-4ab4-87ca-66e8cb7be62c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1368 microversion: 2.1 time: 0.155337 May 25 14:59:40.187349 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 194/400] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:40 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:41.060218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a9c93ef3-4512-47b0-9258-0e09e744ca32 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:41.061090 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a9c93ef3-4512-47b0-9258-0e09e744ca32 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:41.067308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a9c93ef3-4512-47b0-9258-0e09e744ca32 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:41.067757 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a9c93ef3-4512-47b0-9258-0e09e744ca32 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:41.069047 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a9c93ef3-4512-47b0-9258-0e09e744ca32 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:41.069485 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a9c93ef3-4512-47b0-9258-0e09e744ca32 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:41.085347 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:41.203113 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2a77271a-d1f7-4abc-8954-51b9fde3bd4d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:41.203955 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2a77271a-d1f7-4abc-8954-51b9fde3bd4d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:41.205999 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a9c93ef3-4512-47b0-9258-0e09e744ca32 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:41.210354 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2a77271a-d1f7-4abc-8954-51b9fde3bd4d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:41.210793 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2a77271a-d1f7-4abc-8954-51b9fde3bd4d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:41.211563 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2a77271a-d1f7-4abc-8954-51b9fde3bd4d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:41.212039 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2a77271a-d1f7-4abc-8954-51b9fde3bd4d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:41.213722 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a9c93ef3-4512-47b0-9258-0e09e744ca32 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1365 microversion: 2.1 time: 0.157743 May 25 14:59:41.214489 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 207/401] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:41 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:41.400029 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-2a77271a-d1f7-4abc-8954-51b9fde3bd4d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:41.408765 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2a77271a-d1f7-4abc-8954-51b9fde3bd4d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1368 microversion: 2.1 time: 0.209352 May 25 14:59:41.409368 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 195/402] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:41 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:42.232109 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a95d9f72-7cb9-4283-8dc0-e92b0bfa163c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:42.232777 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a95d9f72-7cb9-4283-8dc0-e92b0bfa163c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:42.239042 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a95d9f72-7cb9-4283-8dc0-e92b0bfa163c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:42.239776 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a95d9f72-7cb9-4283-8dc0-e92b0bfa163c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:42.240617 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a95d9f72-7cb9-4283-8dc0-e92b0bfa163c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:42.240948 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a95d9f72-7cb9-4283-8dc0-e92b0bfa163c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:42.383890 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a95d9f72-7cb9-4283-8dc0-e92b0bfa163c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:42.391714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a95d9f72-7cb9-4283-8dc0-e92b0bfa163c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1365 microversion: 2.1 time: 0.164029 May 25 14:59:42.392282 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 208/403] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:42 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:42.426237 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6740d635-c23a-4cd4-98d4-ea2230319314 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:42.426887 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6740d635-c23a-4cd4-98d4-ea2230319314 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:42.434163 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6740d635-c23a-4cd4-98d4-ea2230319314 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:42.434617 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6740d635-c23a-4cd4-98d4-ea2230319314 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:42.435396 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6740d635-c23a-4cd4-98d4-ea2230319314 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:42.435880 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6740d635-c23a-4cd4-98d4-ea2230319314 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:42.579847 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6740d635-c23a-4cd4-98d4-ea2230319314 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:42.587753 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6740d635-c23a-4cd4-98d4-ea2230319314 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1368 microversion: 2.1 time: 0.165338 May 25 14:59:42.588320 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 196/404] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:42 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:43.408686 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-1e3de168-e403-4772-bd8b-58712920d785 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:43.409293 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-1e3de168-e403-4772-bd8b-58712920d785 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:43.416133 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1e3de168-e403-4772-bd8b-58712920d785 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:43.416589 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1e3de168-e403-4772-bd8b-58712920d785 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:43.417446 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1e3de168-e403-4772-bd8b-58712920d785 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:43.417842 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1e3de168-e403-4772-bd8b-58712920d785 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:43.586288 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-1e3de168-e403-4772-bd8b-58712920d785 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:43.599930 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-1e3de168-e403-4772-bd8b-58712920d785 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1365 microversion: 2.1 time: 0.194902 May 25 14:59:43.601621 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 209/405] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:43 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:43.606156 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-f8e501b8-9bb0-4da5-a263-d990f8209942 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:43.606865 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-f8e501b8-9bb0-4da5-a263-d990f8209942 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:43.614628 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f8e501b8-9bb0-4da5-a263-d990f8209942 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:43.615087 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f8e501b8-9bb0-4da5-a263-d990f8209942 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:43.615875 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f8e501b8-9bb0-4da5-a263-d990f8209942 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:43.616886 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f8e501b8-9bb0-4da5-a263-d990f8209942 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:43.756001 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-f8e501b8-9bb0-4da5-a263-d990f8209942 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:43.765180 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-f8e501b8-9bb0-4da5-a263-d990f8209942 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1562 microversion: 2.1 time: 0.163503 May 25 14:59:43.765759 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 197/406] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:43 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:43.781691 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-5b05ee3c-118a-4278-8793-f73943c73c2f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:43.782220 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-5b05ee3c-118a-4278-8793-f73943c73c2f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:43.788406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5b05ee3c-118a-4278-8793-f73943c73c2f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:43.788848 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5b05ee3c-118a-4278-8793-f73943c73c2f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:43.789610 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5b05ee3c-118a-4278-8793-f73943c73c2f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:43.790066 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5b05ee3c-118a-4278-8793-f73943c73c2f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:43.871101 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-5b05ee3c-118a-4278-8793-f73943c73c2f tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093487 May 25 14:59:43.871703 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 210/407] 10.222.0.78 () {58 vars in 1274 bytes} [Wed May 25 14:59:43 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:44.619973 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-cba90b24-cfcf-427a-b72c-18cf52533a29 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:44.621083 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-cba90b24-cfcf-427a-b72c-18cf52533a29 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:44.630633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cba90b24-cfcf-427a-b72c-18cf52533a29 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:44.631497 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cba90b24-cfcf-427a-b72c-18cf52533a29 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:44.633497 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cba90b24-cfcf-427a-b72c-18cf52533a29 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:44.634085 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cba90b24-cfcf-427a-b72c-18cf52533a29 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:44.770830 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-cba90b24-cfcf-427a-b72c-18cf52533a29 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:44.778965 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-cba90b24-cfcf-427a-b72c-18cf52533a29 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1365 microversion: 2.1 time: 0.163805 May 25 14:59:44.779561 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 198/408] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:44 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:45.008344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-2cfbceca-80b8-4c53-a3c3-a86cc4d30165 req-218dd110-3167-4cec-90d6-43ed48864e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58a68392-711b-4106-990e-f6ad82525d59", "tag": "219ede9e-3779-4194-a09a-08090b45e691"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:45.016739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-2cfbceca-80b8-4c53-a3c3-a86cc4d30165 req-218dd110-3167-4cec-90d6-43ed48864e5b service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:45.017169 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-2cfbceca-80b8-4c53-a3c3-a86cc4d30165 req-218dd110-3167-4cec-90d6-43ed48864e5b service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:45.028945 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-2cfbceca-80b8-4c53-a3c3-a86cc4d30165 req-218dd110-3167-4cec-90d6-43ed48864e5b service nova] Creating event network-changed:219ede9e-3779-4194-a09a-08090b45e691 for instance 58a68392-711b-4106-990e-f6ad82525d59 on hv-cinder-80382 May 25 14:59:45.036529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-2cfbceca-80b8-4c53-a3c3-a86cc4d30165 req-218dd110-3167-4cec-90d6-43ed48864e5b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031184 May 25 14:59:45.037412 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 211/409] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:45.796561 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-73edfa6d-617b-4832-b015-86d288657d8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:45.797305 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-73edfa6d-617b-4832-b015-86d288657d8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:45.804896 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-73edfa6d-617b-4832-b015-86d288657d8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:45.805344 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-73edfa6d-617b-4832-b015-86d288657d8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:45.806150 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-73edfa6d-617b-4832-b015-86d288657d8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:45.806587 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-73edfa6d-617b-4832-b015-86d288657d8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:45.961012 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-73edfa6d-617b-4832-b015-86d288657d8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:45.969551 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-73edfa6d-617b-4832-b015-86d288657d8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1365 microversion: 2.1 time: 0.176788 May 25 14:59:45.970151 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 199/410] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:45 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:46.987781 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-46224bbf-6896-4b8a-abf5-f8ba0397f8b5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:46.988932 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-46224bbf-6896-4b8a-abf5-f8ba0397f8b5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:46.996762 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-46224bbf-6896-4b8a-abf5-f8ba0397f8b5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:46.997216 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-46224bbf-6896-4b8a-abf5-f8ba0397f8b5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:46.997990 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-46224bbf-6896-4b8a-abf5-f8ba0397f8b5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:46.998465 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-46224bbf-6896-4b8a-abf5-f8ba0397f8b5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:47.139025 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-46224bbf-6896-4b8a-abf5-f8ba0397f8b5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:47.147034 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-46224bbf-6896-4b8a-abf5-f8ba0397f8b5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1365 microversion: 2.1 time: 0.163615 May 25 14:59:47.148323 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 212/411] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:46 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:48.164803 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2a1b4602-05e3-431b-ac3a-541deb8e5e79 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:48.165412 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2a1b4602-05e3-431b-ac3a-541deb8e5e79 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:48.172199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2a1b4602-05e3-431b-ac3a-541deb8e5e79 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:48.172618 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2a1b4602-05e3-431b-ac3a-541deb8e5e79 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:48.173411 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2a1b4602-05e3-431b-ac3a-541deb8e5e79 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:48.173931 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2a1b4602-05e3-431b-ac3a-541deb8e5e79 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:48.383799 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-2a1b4602-05e3-431b-ac3a-541deb8e5e79 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:48.391903 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2a1b4602-05e3-431b-ac3a-541deb8e5e79 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1365 microversion: 2.1 time: 0.230965 May 25 14:59:48.392545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 200/412] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:48 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:48.607881 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-8f1796e0-5233-46f4-9c4a-7659d24f943e req-c481557d-7704-4e13-92fb-6fef0589a315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f150bd82-8a04-4a33-bebd-594f65f1d6a7", "name": "network-vif-plugged", "status": "completed", "tag": "bedd3cb1-f210-414d-ada2-ad2ffd6d01ae"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:48.617937 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-8f1796e0-5233-46f4-9c4a-7659d24f943e req-c481557d-7704-4e13-92fb-6fef0589a315 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:48.618425 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-8f1796e0-5233-46f4-9c4a-7659d24f943e req-c481557d-7704-4e13-92fb-6fef0589a315 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:48.630900 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-8f1796e0-5233-46f4-9c4a-7659d24f943e req-c481557d-7704-4e13-92fb-6fef0589a315 service nova] Creating event network-vif-plugged:bedd3cb1-f210-414d-ada2-ad2ffd6d01ae for instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 on hv-cinder-80382 May 25 14:59:48.636561 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-8f1796e0-5233-46f4-9c4a-7659d24f943e req-c481557d-7704-4e13-92fb-6fef0589a315 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032769 May 25 14:59:48.638144 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 213/413] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:49.409505 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-51670e03-1e62-452e-bfcf-84ed35d05de1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:49.410209 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-51670e03-1e62-452e-bfcf-84ed35d05de1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:49.417315 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-51670e03-1e62-452e-bfcf-84ed35d05de1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:49.417753 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-51670e03-1e62-452e-bfcf-84ed35d05de1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:49.418553 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-51670e03-1e62-452e-bfcf-84ed35d05de1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:49.418989 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-51670e03-1e62-452e-bfcf-84ed35d05de1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:49.555348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-51670e03-1e62-452e-bfcf-84ed35d05de1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:49.563224 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-51670e03-1e62-452e-bfcf-84ed35d05de1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1365 microversion: 2.1 time: 0.157645 May 25 14:59:49.563789 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 201/414] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:49 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:50.580849 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a08f69f3-e78e-4dfb-a45e-477cc86c869c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:50.581540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a08f69f3-e78e-4dfb-a45e-477cc86c869c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:50.588447 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a08f69f3-e78e-4dfb-a45e-477cc86c869c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:50.588886 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a08f69f3-e78e-4dfb-a45e-477cc86c869c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:50.589640 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a08f69f3-e78e-4dfb-a45e-477cc86c869c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:50.590089 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a08f69f3-e78e-4dfb-a45e-477cc86c869c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:50.732551 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a08f69f3-e78e-4dfb-a45e-477cc86c869c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:50.740362 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a08f69f3-e78e-4dfb-a45e-477cc86c869c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1365 microversion: 2.1 time: 0.163767 May 25 14:59:50.740940 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 214/415] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:50 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:51.099970 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-e0d3cfd8-604b-4c8f-bb07-6b5b8c6303ea tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-245677048", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1398894099", "security_groups": [{"name": "tempest-secgroup-smoke-1278455577"}], "block_device_mapping_v2": [{"uuid": "02ec8157-ae77-452b-8f89-3383d1bbb3ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "620eaca4-828c-4c2d-a756-ed68aa31fbcf"}]}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:51.241564 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.network.neutron [None req-e0d3cfd8-604b-4c8f-bb07-6b5b8c6303ea tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] validate_networks() for [('620eaca4-828c-4c2d-a756-ed68aa31fbcf', None, None, None, None, None)] {{(pid=124524) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:59:51.613282 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-e0d3cfd8-604b-4c8f-bb07-6b5b8c6303ea tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Flavor limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:59:51.613701 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-e0d3cfd8-604b-4c8f-bb07-6b5b8c6303ea tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Image limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:59:51.614236 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-e0d3cfd8-604b-4c8f-bb07-6b5b8c6303ea tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Flavor pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:59:51.614640 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-e0d3cfd8-604b-4c8f-bb07-6b5b8c6303ea tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Image pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:59:51.615051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-e0d3cfd8-604b-4c8f-bb07-6b5b8c6303ea tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:59:51.625170 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e0d3cfd8-604b-4c8f-bb07-6b5b8c6303ea tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:51.625612 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e0d3cfd8-604b-4c8f-bb07-6b5b8c6303ea tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:51.626463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e0d3cfd8-604b-4c8f-bb07-6b5b8c6303ea tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:51.626909 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e0d3cfd8-604b-4c8f-bb07-6b5b8c6303ea tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:51.645777 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-e0d3cfd8-604b-4c8f-bb07-6b5b8c6303ea tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Getting quotas for project 99281bdc8f6340a1be03774c255ae4ba. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:59:51.650321 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-e0d3cfd8-604b-4c8f-bb07-6b5b8c6303ea tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Getting quotas for user daec78050ee547699910603eff8cb7ca and project 99281bdc8f6340a1be03774c255ae4ba. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:59:51.707633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-e0d3cfd8-604b-4c8f-bb07-6b5b8c6303ea tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Going to run 1 instances... {{(pid=124524) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:59:51.709733 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-e0d3cfd8-604b-4c8f-bb07-6b5b8c6303ea tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='02ec8157-ae77-452b-8f89-3383d1bbb3ee',volume_size=None,volume_type=None)] {{(pid=124524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:59:51.758473 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a7b80f7d-7bba-4c5e-b37d-4a5bf52e59cc tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:51.759063 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a7b80f7d-7bba-4c5e-b37d-4a5bf52e59cc tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:51.765696 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a7b80f7d-7bba-4c5e-b37d-4a5bf52e59cc tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:51.766173 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a7b80f7d-7bba-4c5e-b37d-4a5bf52e59cc tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:51.766929 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a7b80f7d-7bba-4c5e-b37d-4a5bf52e59cc tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:51.767355 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a7b80f7d-7bba-4c5e-b37d-4a5bf52e59cc tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:51.843975 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-e0d3cfd8-604b-4c8f-bb07-6b5b8c6303ea tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.747710 May 25 14:59:51.849656 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 202/416] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 14:59:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 14:59:51.856335 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-56a7eb1e-dd09-4e6a-a062-d0b1c694d72c tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:51.857221 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-56a7eb1e-dd09-4e6a-a062-d0b1c694d72c tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:51.922099 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-56a7eb1e-dd09-4e6a-a062-d0b1c694d72c tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:51.933874 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-56a7eb1e-dd09-4e6a-a062-d0b1c694d72c tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1094 microversion: 2.1 time: 0.082716 May 25 14:59:51.934507 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 203/417] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:51 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:51.955484 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a7b80f7d-7bba-4c5e-b37d-4a5bf52e59cc tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:51.963759 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a7b80f7d-7bba-4c5e-b37d-4a5bf52e59cc tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1556 microversion: 2.1 time: 0.210000 May 25 14:59:51.975349 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 215/418] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:51 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1556 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:51.982409 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-bc5aadfb-18d8-4a01-8814-9ce0cfa75922 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:51.983208 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-bc5aadfb-18d8-4a01-8814-9ce0cfa75922 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:51.991908 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bc5aadfb-18d8-4a01-8814-9ce0cfa75922 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:51.992354 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bc5aadfb-18d8-4a01-8814-9ce0cfa75922 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:51.993146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bc5aadfb-18d8-4a01-8814-9ce0cfa75922 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:51.993582 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bc5aadfb-18d8-4a01-8814-9ce0cfa75922 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:52.101674 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-bc5aadfb-18d8-4a01-8814-9ce0cfa75922 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124274 May 25 14:59:52.107866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 204/419] 10.222.0.78 () {58 vars in 1274 bytes} [Wed May 25 14:59:51 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:52.951662 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-52a14fe1-f6eb-41c3-97bc-8d0670051a85 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:52.952284 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-52a14fe1-f6eb-41c3-97bc-8d0670051a85 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:52.959311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-52a14fe1-f6eb-41c3-97bc-8d0670051a85 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:52.959942 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-52a14fe1-f6eb-41c3-97bc-8d0670051a85 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:52.961239 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-52a14fe1-f6eb-41c3-97bc-8d0670051a85 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:52.961682 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-52a14fe1-f6eb-41c3-97bc-8d0670051a85 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:53.049181 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-52a14fe1-f6eb-41c3-97bc-8d0670051a85 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:53.056866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-52a14fe1-f6eb-41c3-97bc-8d0670051a85 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1192 microversion: 2.1 time: 0.109736 May 25 14:59:53.057652 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 216/420] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:52 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1192 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:53.464176 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-0a316ef3-0625-42a5-bdee-d384268cdb67 req-66c2437e-bb89-4817-911d-1c8f91815a78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f150bd82-8a04-4a33-bebd-594f65f1d6a7", "tag": "bedd3cb1-f210-414d-ada2-ad2ffd6d01ae"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:53.476893 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-0a316ef3-0625-42a5-bdee-d384268cdb67 req-66c2437e-bb89-4817-911d-1c8f91815a78 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:53.477624 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-0a316ef3-0625-42a5-bdee-d384268cdb67 req-66c2437e-bb89-4817-911d-1c8f91815a78 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:53.490186 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-0a316ef3-0625-42a5-bdee-d384268cdb67 req-66c2437e-bb89-4817-911d-1c8f91815a78 service nova] Creating event network-changed:bedd3cb1-f210-414d-ada2-ad2ffd6d01ae for instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 on hv-cinder-80382 May 25 14:59:53.496700 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-0a316ef3-0625-42a5-bdee-d384268cdb67 req-66c2437e-bb89-4817-911d-1c8f91815a78 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039975 May 25 14:59:53.497899 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 205/421] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:54.078206 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-5b3384fd-5fe7-460e-b4d6-92f9f9702527 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:54.079107 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-5b3384fd-5fe7-460e-b4d6-92f9f9702527 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:54.091262 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5b3384fd-5fe7-460e-b4d6-92f9f9702527 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:54.092267 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5b3384fd-5fe7-460e-b4d6-92f9f9702527 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:54.093482 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5b3384fd-5fe7-460e-b4d6-92f9f9702527 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:54.094380 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5b3384fd-5fe7-460e-b4d6-92f9f9702527 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:54.216987 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5b3384fd-5fe7-460e-b4d6-92f9f9702527 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:54.225346 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-5b3384fd-5fe7-460e-b4d6-92f9f9702527 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1210 microversion: 2.1 time: 0.152810 May 25 14:59:54.226314 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 217/422] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:54 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1210 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:55.244642 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-5b779279-f774-403d-a4de-a25692577668 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:55.245344 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-5b779279-f774-403d-a4de-a25692577668 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:55.251921 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5b779279-f774-403d-a4de-a25692577668 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:55.252371 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5b779279-f774-403d-a4de-a25692577668 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:55.253138 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5b779279-f774-403d-a4de-a25692577668 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:55.253579 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5b779279-f774-403d-a4de-a25692577668 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:55.390826 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-5b779279-f774-403d-a4de-a25692577668 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:55.398480 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-5b779279-f774-403d-a4de-a25692577668 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1278 microversion: 2.1 time: 0.159129 May 25 14:59:55.399044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 206/423] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:55 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:56.361182 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-91522d34-d387-4d0b-bdfd-e090ab9769e1 req-e3d3f5f5-c6bc-4571-9f38-5fbfa02a5362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a712db2a-4e2e-46b3-a696-9396ea8c5209", "tag": "2a1f0f94-24f2-48c9-b837-2cd6a40fd1bc"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:56.372640 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-91522d34-d387-4d0b-bdfd-e090ab9769e1 req-e3d3f5f5-c6bc-4571-9f38-5fbfa02a5362 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:56.373081 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-91522d34-d387-4d0b-bdfd-e090ab9769e1 req-e3d3f5f5-c6bc-4571-9f38-5fbfa02a5362 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:56.387393 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-91522d34-d387-4d0b-bdfd-e090ab9769e1 req-e3d3f5f5-c6bc-4571-9f38-5fbfa02a5362 service nova] Creating event network-changed:2a1f0f94-24f2-48c9-b837-2cd6a40fd1bc for instance a712db2a-4e2e-46b3-a696-9396ea8c5209 on hv-cinder-80382 May 25 14:59:56.392514 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-91522d34-d387-4d0b-bdfd-e090ab9769e1 req-e3d3f5f5-c6bc-4571-9f38-5fbfa02a5362 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034905 May 25 14:59:56.393377 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 218/424] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 14:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:56.415060 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-964caffe-626f-4559-b7fc-e0ee86f5ffba tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:56.415672 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-964caffe-626f-4559-b7fc-e0ee86f5ffba tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:56.422296 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-964caffe-626f-4559-b7fc-e0ee86f5ffba tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:56.422907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-964caffe-626f-4559-b7fc-e0ee86f5ffba tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:56.423759 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-964caffe-626f-4559-b7fc-e0ee86f5ffba tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:56.424230 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-964caffe-626f-4559-b7fc-e0ee86f5ffba tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:56.562444 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-964caffe-626f-4559-b7fc-e0ee86f5ffba tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:56.571645 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-964caffe-626f-4559-b7fc-e0ee86f5ffba tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1266 microversion: 2.1 time: 0.160362 May 25 14:59:56.572402 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 207/425] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:56 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:57.591514 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-7b7100e3-3a47-412c-96a6-630de18cdcc6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:57.592886 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-7b7100e3-3a47-412c-96a6-630de18cdcc6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:57.607380 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7b7100e3-3a47-412c-96a6-630de18cdcc6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:57.608129 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7b7100e3-3a47-412c-96a6-630de18cdcc6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:57.609418 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7b7100e3-3a47-412c-96a6-630de18cdcc6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:57.610140 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7b7100e3-3a47-412c-96a6-630de18cdcc6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:57.820388 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-7b7100e3-3a47-412c-96a6-630de18cdcc6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:57.828166 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-7b7100e3-3a47-412c-96a6-630de18cdcc6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1266 microversion: 2.1 time: 0.243063 May 25 14:59:57.828771 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 219/426] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:57 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:58.845613 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-5d1270ba-8639-4236-9855-2f975ccd6722 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:58.846162 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-5d1270ba-8639-4236-9855-2f975ccd6722 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:58.848663 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:58.854838 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5d1270ba-8639-4236-9855-2f975ccd6722 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:58.855292 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5d1270ba-8639-4236-9855-2f975ccd6722 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:58.856073 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5d1270ba-8639-4236-9855-2f975ccd6722 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:58.856509 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5d1270ba-8639-4236-9855-2f975ccd6722 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:58.991304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-5d1270ba-8639-4236-9855-2f975ccd6722 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:58.998677 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-5d1270ba-8639-4236-9855-2f975ccd6722 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1266 microversion: 2.1 time: 0.157179 May 25 14:59:58.999238 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 208/427] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 14:59:58 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:00.015975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-dfdd1106-b605-4950-b2c2-8ff0e55be962 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:00.016574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-dfdd1106-b605-4950-b2c2-8ff0e55be962 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:00.023306 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dfdd1106-b605-4950-b2c2-8ff0e55be962 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:00.023749 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dfdd1106-b605-4950-b2c2-8ff0e55be962 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:00.024527 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dfdd1106-b605-4950-b2c2-8ff0e55be962 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:00.024954 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dfdd1106-b605-4950-b2c2-8ff0e55be962 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:00.158089 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-dfdd1106-b605-4950-b2c2-8ff0e55be962 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:00.165444 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-dfdd1106-b605-4950-b2c2-8ff0e55be962 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1266 microversion: 2.1 time: 0.153527 May 25 15:00:00.165997 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 220/428] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:00 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:01.182068 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-3b638297-c521-45ca-8ae7-9254459db923 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:01.182587 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-3b638297-c521-45ca-8ae7-9254459db923 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:01.189135 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3b638297-c521-45ca-8ae7-9254459db923 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:01.189579 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3b638297-c521-45ca-8ae7-9254459db923 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:01.190372 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3b638297-c521-45ca-8ae7-9254459db923 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:01.190811 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3b638297-c521-45ca-8ae7-9254459db923 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:01.323936 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3b638297-c521-45ca-8ae7-9254459db923 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:01.331385 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-3b638297-c521-45ca-8ae7-9254459db923 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1266 microversion: 2.1 time: 0.153284 May 25 15:00:01.331941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 209/429] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:01 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:02.348578 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ec082a9b-8b5e-47d3-b3e4-b345ea65d901 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:02.349193 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ec082a9b-8b5e-47d3-b3e4-b345ea65d901 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:02.355329 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ec082a9b-8b5e-47d3-b3e4-b345ea65d901 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:02.355782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ec082a9b-8b5e-47d3-b3e4-b345ea65d901 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:02.356549 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ec082a9b-8b5e-47d3-b3e4-b345ea65d901 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:02.356988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ec082a9b-8b5e-47d3-b3e4-b345ea65d901 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:02.487131 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ec082a9b-8b5e-47d3-b3e4-b345ea65d901 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:02.495138 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ec082a9b-8b5e-47d3-b3e4-b345ea65d901 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1266 microversion: 2.1 time: 0.150412 May 25 15:00:02.495703 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 221/430] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:02 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:03.513008 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-ea282817-726e-46f1-b489-d5b68fa58797 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:03.513641 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-ea282817-726e-46f1-b489-d5b68fa58797 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:03.515594 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:03.516303 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=8 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:03.523517 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ea282817-726e-46f1-b489-d5b68fa58797 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:03.523969 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ea282817-726e-46f1-b489-d5b68fa58797 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:03.524744 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ea282817-726e-46f1-b489-d5b68fa58797 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:03.525183 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ea282817-726e-46f1-b489-d5b68fa58797 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:03.659795 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-ea282817-726e-46f1-b489-d5b68fa58797 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:03.667947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-ea282817-726e-46f1-b489-d5b68fa58797 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1266 microversion: 2.1 time: 0.159185 May 25 15:00:03.668671 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 210/431] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:03 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:04.685280 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4b2f1d2c-70e1-473d-a0d5-512b637f2776 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:04.686001 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4b2f1d2c-70e1-473d-a0d5-512b637f2776 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:04.688085 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=46 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:04.696871 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4b2f1d2c-70e1-473d-a0d5-512b637f2776 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:04.697613 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4b2f1d2c-70e1-473d-a0d5-512b637f2776 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:04.698443 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4b2f1d2c-70e1-473d-a0d5-512b637f2776 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:04.698968 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4b2f1d2c-70e1-473d-a0d5-512b637f2776 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:04.849251 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4b2f1d2c-70e1-473d-a0d5-512b637f2776 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:04.857044 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4b2f1d2c-70e1-473d-a0d5-512b637f2776 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1266 microversion: 2.1 time: 0.175637 May 25 15:00:04.857623 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 222/432] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:04 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:05.873885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8271e04a-668a-40d0-bae1-aa7909af51c5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:05.874550 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-8271e04a-668a-40d0-bae1-aa7909af51c5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:05.881223 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8271e04a-668a-40d0-bae1-aa7909af51c5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:05.882207 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8271e04a-668a-40d0-bae1-aa7909af51c5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:05.882967 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8271e04a-668a-40d0-bae1-aa7909af51c5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:05.883401 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8271e04a-668a-40d0-bae1-aa7909af51c5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:06.028514 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-8271e04a-668a-40d0-bae1-aa7909af51c5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:06.036384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-8271e04a-668a-40d0-bae1-aa7909af51c5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1266 microversion: 2.1 time: 0.166293 May 25 15:00:06.036967 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 211/433] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:05 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:07.058125 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-488ea99f-9846-46ce-8c3c-044ebe29aa92 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:07.059258 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-488ea99f-9846-46ce-8c3c-044ebe29aa92 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:07.069588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-488ea99f-9846-46ce-8c3c-044ebe29aa92 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:07.070083 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-488ea99f-9846-46ce-8c3c-044ebe29aa92 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:07.070908 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-488ea99f-9846-46ce-8c3c-044ebe29aa92 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:07.071353 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-488ea99f-9846-46ce-8c3c-044ebe29aa92 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:07.198984 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-d249f2a5-9077-439f-af4d-019304a62e81 req-d8f348de-2f33-466d-a17b-00777dd2c106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a712db2a-4e2e-46b3-a696-9396ea8c5209", "name": "network-vif-plugged", "status": "completed", "tag": "2a1f0f94-24f2-48c9-b837-2cd6a40fd1bc"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:00:07.208122 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-d249f2a5-9077-439f-af4d-019304a62e81 req-d8f348de-2f33-466d-a17b-00777dd2c106 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:07.208601 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-d249f2a5-9077-439f-af4d-019304a62e81 req-d8f348de-2f33-466d-a17b-00777dd2c106 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:07.222513 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-d249f2a5-9077-439f-af4d-019304a62e81 req-d8f348de-2f33-466d-a17b-00777dd2c106 service nova] Creating event network-vif-plugged:2a1f0f94-24f2-48c9-b837-2cd6a40fd1bc for instance a712db2a-4e2e-46b3-a696-9396ea8c5209 on hv-cinder-80382 May 25 15:00:07.226971 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-488ea99f-9846-46ce-8c3c-044ebe29aa92 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:07.228402 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-d249f2a5-9077-439f-af4d-019304a62e81 req-d8f348de-2f33-466d-a17b-00777dd2c106 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033079 May 25 15:00:07.229080 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 212/434] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:00:07.234826 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-488ea99f-9846-46ce-8c3c-044ebe29aa92 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1266 microversion: 2.1 time: 0.184859 May 25 15:00:07.235421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 223/435] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:07 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:08.253406 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0809eb83-478f-4151-a9d4-feb25a28881d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:08.254133 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0809eb83-478f-4151-a9d4-feb25a28881d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:08.261104 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0809eb83-478f-4151-a9d4-feb25a28881d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:08.261544 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0809eb83-478f-4151-a9d4-feb25a28881d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:08.262634 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0809eb83-478f-4151-a9d4-feb25a28881d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:08.263060 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0809eb83-478f-4151-a9d4-feb25a28881d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:08.401557 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-0809eb83-478f-4151-a9d4-feb25a28881d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:08.413334 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0809eb83-478f-4151-a9d4-feb25a28881d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1266 microversion: 2.1 time: 0.164171 May 25 15:00:08.416940 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 213/436] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:08 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:09.439742 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ef04aac1-6f04-448b-af14-dac71a5d706a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:09.440503 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ef04aac1-6f04-448b-af14-dac71a5d706a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:09.449440 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ef04aac1-6f04-448b-af14-dac71a5d706a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:09.449891 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ef04aac1-6f04-448b-af14-dac71a5d706a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:09.450727 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ef04aac1-6f04-448b-af14-dac71a5d706a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:09.451160 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ef04aac1-6f04-448b-af14-dac71a5d706a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:09.606831 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ef04aac1-6f04-448b-af14-dac71a5d706a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:09.614877 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ef04aac1-6f04-448b-af14-dac71a5d706a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1266 microversion: 2.1 time: 0.180547 May 25 15:00:09.615460 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 224/437] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:09 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:10.631570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1cf71a49-46de-4da5-b914-a1f3f6355d10 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:10.632175 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1cf71a49-46de-4da5-b914-a1f3f6355d10 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:10.639593 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1cf71a49-46de-4da5-b914-a1f3f6355d10 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:10.640047 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1cf71a49-46de-4da5-b914-a1f3f6355d10 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:10.640837 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1cf71a49-46de-4da5-b914-a1f3f6355d10 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:10.641330 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1cf71a49-46de-4da5-b914-a1f3f6355d10 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:10.644373 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=99 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:10.781280 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1cf71a49-46de-4da5-b914-a1f3f6355d10 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:10.789662 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1cf71a49-46de-4da5-b914-a1f3f6355d10 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1452 microversion: 2.1 time: 0.161930 May 25 15:00:10.790273 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 214/438] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:10 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:10.806145 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-7a4b3e28-4275-48f8-9d58-1f4d90601445 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:10.806989 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-7a4b3e28-4275-48f8-9d58-1f4d90601445 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:10.813318 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7a4b3e28-4275-48f8-9d58-1f4d90601445 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:10.813727 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7a4b3e28-4275-48f8-9d58-1f4d90601445 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:10.814538 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7a4b3e28-4275-48f8-9d58-1f4d90601445 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:10.814972 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7a4b3e28-4275-48f8-9d58-1f4d90601445 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:10.953658 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-7a4b3e28-4275-48f8-9d58-1f4d90601445 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:10.962139 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-7a4b3e28-4275-48f8-9d58-1f4d90601445 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1452 microversion: 2.1 time: 0.159757 May 25 15:00:10.962715 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 225/439] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:10 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:13.055567 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-c6bba39f-d562-4bcc-b22a-07e164c3449f req-e6e50df2-ac51-417d-aa8f-5379a478122f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a712db2a-4e2e-46b3-a696-9396ea8c5209", "tag": "2a1f0f94-24f2-48c9-b837-2cd6a40fd1bc"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:00:13.064625 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-c6bba39f-d562-4bcc-b22a-07e164c3449f req-e6e50df2-ac51-417d-aa8f-5379a478122f service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:13.065094 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-c6bba39f-d562-4bcc-b22a-07e164c3449f req-e6e50df2-ac51-417d-aa8f-5379a478122f service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:13.077718 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-c6bba39f-d562-4bcc-b22a-07e164c3449f req-e6e50df2-ac51-417d-aa8f-5379a478122f service nova] Creating event network-changed:2a1f0f94-24f2-48c9-b837-2cd6a40fd1bc for instance a712db2a-4e2e-46b3-a696-9396ea8c5209 on hv-cinder-80382 May 25 15:00:13.083095 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-c6bba39f-d562-4bcc-b22a-07e164c3449f req-e6e50df2-ac51-417d-aa8f-5379a478122f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031131 May 25 15:00:13.083824 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 215/440] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:00:36.116062 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-71860cf1-71d3-4e53-9160-f4167caa00fd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:36.116622 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-71860cf1-71d3-4e53-9160-f4167caa00fd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:36.118586 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=7 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:36.119233 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=97 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:36.125162 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-71860cf1-71d3-4e53-9160-f4167caa00fd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:36.125605 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-71860cf1-71d3-4e53-9160-f4167caa00fd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:36.126400 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-71860cf1-71d3-4e53-9160-f4167caa00fd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:36.126836 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-71860cf1-71d3-4e53-9160-f4167caa00fd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:36.252931 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.objects.instance [None req-71860cf1-71d3-4e53-9160-f4167caa00fd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lazy-loading 'services' on Instance uuid 6be96576-0efd-4362-8e0d-f74b16ddc912 {{(pid=124523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:00:36.368299 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-71860cf1-71d3-4e53-9160-f4167caa00fd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912/os-volume_attachments/2e376299-8aaa-4648-9d35-17ebb9e5e3e0" status: 202 len: 0 microversion: 2.1 time: 0.255643 May 25 15:00:36.369161 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 226/441] 10.222.0.78 () {58 vars in 1415 bytes} [Wed May 25 15:00:36 2022] DELETE /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912/os-volume_attachments/2e376299-8aaa-4648-9d35-17ebb9e5e3e0 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:00:38.534561 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=15 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:38.535300 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=7 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:38.540074 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-47f42fb3-ec40-4806-b6d0-4a8cd3ccfe22 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:00:38.547066 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-47f42fb3-ec40-4806-b6d0-4a8cd3ccfe22 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:38.547514 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-47f42fb3-ec40-4806-b6d0-4a8cd3ccfe22 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:38.569192 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-47f42fb3-ec40-4806-b6d0-4a8cd3ccfe22 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Going to try to stop instance {{(pid=124524) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 25 15:00:38.612668 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-47f42fb3-ec40-4806-b6d0-4a8cd3ccfe22 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "POST /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912/action" status: 202 len: 0 microversion: 2.1 time: 0.079496 May 25 15:00:38.613317 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 216/442] 10.222.0.78 () {60 vars in 1277 bytes} [Wed May 25 15:00:38 2022] POST /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:00:38.621920 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8266fd8d-4ca9-4340-b1f1-7b70284ce488 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:38.622674 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8266fd8d-4ca9-4340-b1f1-7b70284ce488 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:38.628956 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8266fd8d-4ca9-4340-b1f1-7b70284ce488 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:38.629411 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8266fd8d-4ca9-4340-b1f1-7b70284ce488 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:38.630264 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8266fd8d-4ca9-4340-b1f1-7b70284ce488 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:38.630751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8266fd8d-4ca9-4340-b1f1-7b70284ce488 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:38.767118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8266fd8d-4ca9-4340-b1f1-7b70284ce488 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:38.775323 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8266fd8d-4ca9-4340-b1f1-7b70284ce488 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1674 microversion: 2.1 time: 0.157597 May 25 15:00:38.775920 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 227/443] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:38 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:39.794145 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1a2600d6-e46c-42aa-a6f8-c26b37a95cd2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:39.794935 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1a2600d6-e46c-42aa-a6f8-c26b37a95cd2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:39.801420 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1a2600d6-e46c-42aa-a6f8-c26b37a95cd2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:39.801870 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1a2600d6-e46c-42aa-a6f8-c26b37a95cd2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:39.802670 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1a2600d6-e46c-42aa-a6f8-c26b37a95cd2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:39.803110 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1a2600d6-e46c-42aa-a6f8-c26b37a95cd2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:39.939523 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1a2600d6-e46c-42aa-a6f8-c26b37a95cd2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:39.947573 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1a2600d6-e46c-42aa-a6f8-c26b37a95cd2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1674 microversion: 2.1 time: 0.158489 May 25 15:00:39.948135 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 217/444] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:39 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:40.965994 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2fcbf999-9241-44b7-bbb4-0b6a172e8fb7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:40.966624 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2fcbf999-9241-44b7-bbb4-0b6a172e8fb7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:40.972773 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2fcbf999-9241-44b7-bbb4-0b6a172e8fb7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:40.973220 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2fcbf999-9241-44b7-bbb4-0b6a172e8fb7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:40.974594 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2fcbf999-9241-44b7-bbb4-0b6a172e8fb7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:40.975034 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2fcbf999-9241-44b7-bbb4-0b6a172e8fb7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:41.103390 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2fcbf999-9241-44b7-bbb4-0b6a172e8fb7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:41.110878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2fcbf999-9241-44b7-bbb4-0b6a172e8fb7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1674 microversion: 2.1 time: 0.148845 May 25 15:00:41.111446 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 228/445] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:40 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:42.127822 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-48a57d72-f371-46de-97f4-ce293e113e9e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:42.128449 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-48a57d72-f371-46de-97f4-ce293e113e9e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:42.134918 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-48a57d72-f371-46de-97f4-ce293e113e9e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:42.135370 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-48a57d72-f371-46de-97f4-ce293e113e9e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:42.136380 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-48a57d72-f371-46de-97f4-ce293e113e9e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:42.136808 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-48a57d72-f371-46de-97f4-ce293e113e9e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:42.263298 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-48a57d72-f371-46de-97f4-ce293e113e9e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:42.271908 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-48a57d72-f371-46de-97f4-ce293e113e9e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1674 microversion: 2.1 time: 0.147787 May 25 15:00:42.272403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 218/446] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:42 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:43.289649 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-bdd82e23-c793-479c-9613-334a36fc703c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:43.290322 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-bdd82e23-c793-479c-9613-334a36fc703c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:43.296441 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bdd82e23-c793-479c-9613-334a36fc703c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:43.296866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bdd82e23-c793-479c-9613-334a36fc703c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:43.297629 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bdd82e23-c793-479c-9613-334a36fc703c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:43.298090 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bdd82e23-c793-479c-9613-334a36fc703c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:43.430257 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-bdd82e23-c793-479c-9613-334a36fc703c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:43.438324 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-bdd82e23-c793-479c-9613-334a36fc703c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1674 microversion: 2.1 time: 0.153249 May 25 15:00:43.438895 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 229/447] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:43 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:44.455990 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-49381202-0a9b-49c1-ae35-89a0954bec8a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:44.456583 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-49381202-0a9b-49c1-ae35-89a0954bec8a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:44.463591 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-49381202-0a9b-49c1-ae35-89a0954bec8a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:44.464045 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-49381202-0a9b-49c1-ae35-89a0954bec8a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:44.464815 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-49381202-0a9b-49c1-ae35-89a0954bec8a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:44.465252 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-49381202-0a9b-49c1-ae35-89a0954bec8a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:44.602292 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-49381202-0a9b-49c1-ae35-89a0954bec8a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:44.609935 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-49381202-0a9b-49c1-ae35-89a0954bec8a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1674 microversion: 2.1 time: 0.157895 May 25 15:00:44.610534 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 219/448] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:44 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:45.627289 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-7049c7a6-6cb6-4fc9-bbf2-f89c0585011b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:45.627850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-7049c7a6-6cb6-4fc9-bbf2-f89c0585011b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:45.633841 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7049c7a6-6cb6-4fc9-bbf2-f89c0585011b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:45.634325 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7049c7a6-6cb6-4fc9-bbf2-f89c0585011b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:45.635088 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7049c7a6-6cb6-4fc9-bbf2-f89c0585011b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:45.635794 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7049c7a6-6cb6-4fc9-bbf2-f89c0585011b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:45.762266 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-7049c7a6-6cb6-4fc9-bbf2-f89c0585011b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:45.769698 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-7049c7a6-6cb6-4fc9-bbf2-f89c0585011b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1674 microversion: 2.1 time: 0.146408 May 25 15:00:45.770302 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 230/449] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:45 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:46.787620 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-4d9e6f27-f884-4afc-be6f-975bb6b32c61 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:46.788229 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-4d9e6f27-f884-4afc-be6f-975bb6b32c61 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:46.794768 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4d9e6f27-f884-4afc-be6f-975bb6b32c61 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:46.795216 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4d9e6f27-f884-4afc-be6f-975bb6b32c61 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:46.795978 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4d9e6f27-f884-4afc-be6f-975bb6b32c61 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:46.796414 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4d9e6f27-f884-4afc-be6f-975bb6b32c61 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:46.923971 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-4d9e6f27-f884-4afc-be6f-975bb6b32c61 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:46.931385 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-4d9e6f27-f884-4afc-be6f-975bb6b32c61 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1674 microversion: 2.1 time: 0.148340 May 25 15:00:46.931946 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 220/450] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:46 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:47.948950 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-53040051-8d2b-49bb-9a48-00ceb6f98f97 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:47.949492 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-53040051-8d2b-49bb-9a48-00ceb6f98f97 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:47.956747 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-53040051-8d2b-49bb-9a48-00ceb6f98f97 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:47.957197 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-53040051-8d2b-49bb-9a48-00ceb6f98f97 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:47.957976 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-53040051-8d2b-49bb-9a48-00ceb6f98f97 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:47.959031 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-53040051-8d2b-49bb-9a48-00ceb6f98f97 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:48.086436 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-53040051-8d2b-49bb-9a48-00ceb6f98f97 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:48.093905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-53040051-8d2b-49bb-9a48-00ceb6f98f97 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1674 microversion: 2.1 time: 0.148864 May 25 15:00:48.094509 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 231/451] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:47 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:49.110823 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-cfdff762-c7c7-47c0-930c-1a886d29d443 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:49.111433 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-cfdff762-c7c7-47c0-930c-1a886d29d443 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:49.118296 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cfdff762-c7c7-47c0-930c-1a886d29d443 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:49.118748 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cfdff762-c7c7-47c0-930c-1a886d29d443 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:49.119514 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cfdff762-c7c7-47c0-930c-1a886d29d443 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:49.120030 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cfdff762-c7c7-47c0-930c-1a886d29d443 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:49.247867 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-cfdff762-c7c7-47c0-930c-1a886d29d443 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:49.255529 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-cfdff762-c7c7-47c0-930c-1a886d29d443 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1674 microversion: 2.1 time: 0.148494 May 25 15:00:49.256130 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 221/452] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:49 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:50.272714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4f04e947-314c-4dda-8ca0-4367d8d50df4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:50.273375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4f04e947-314c-4dda-8ca0-4367d8d50df4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:50.280126 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4f04e947-314c-4dda-8ca0-4367d8d50df4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:50.280599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4f04e947-314c-4dda-8ca0-4367d8d50df4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:50.281338 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4f04e947-314c-4dda-8ca0-4367d8d50df4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:50.281783 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4f04e947-314c-4dda-8ca0-4367d8d50df4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:50.412409 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4f04e947-314c-4dda-8ca0-4367d8d50df4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:50.420596 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4f04e947-314c-4dda-8ca0-4367d8d50df4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1674 microversion: 2.1 time: 0.151760 May 25 15:00:50.421096 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 232/453] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:50 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:51.437974 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-67570d9f-3d1d-41cb-8810-794816a9a6ec tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:51.438611 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-67570d9f-3d1d-41cb-8810-794816a9a6ec tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:51.445680 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-67570d9f-3d1d-41cb-8810-794816a9a6ec tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:51.446149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-67570d9f-3d1d-41cb-8810-794816a9a6ec tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:51.446910 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-67570d9f-3d1d-41cb-8810-794816a9a6ec tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:51.447336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-67570d9f-3d1d-41cb-8810-794816a9a6ec tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:51.586122 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-67570d9f-3d1d-41cb-8810-794816a9a6ec tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:51.597534 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-67570d9f-3d1d-41cb-8810-794816a9a6ec tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1674 microversion: 2.1 time: 0.162984 May 25 15:00:51.600813 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 222/454] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:51 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:52.449186 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3d7258b0-0e7d-4eab-b832-5f6fbb5961c2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:52.449743 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-3d7258b0-0e7d-4eab-b832-5f6fbb5961c2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:52.455777 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3d7258b0-0e7d-4eab-b832-5f6fbb5961c2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:52.456224 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3d7258b0-0e7d-4eab-b832-5f6fbb5961c2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:52.456991 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3d7258b0-0e7d-4eab-b832-5f6fbb5961c2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:52.457426 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3d7258b0-0e7d-4eab-b832-5f6fbb5961c2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:52.480147 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3d7258b0-0e7d-4eab-b832-5f6fbb5961c2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7/ips" status: 200 len: 151 microversion: 2.1 time: 0.034928 May 25 15:00:52.480723 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 233/455] 10.222.0.78 () {58 vars in 1247 bytes} [Wed May 25 15:00:52 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:00:52.492800 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0bb64d3a-747e-4190-aa4b-570ac8dbeaf5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6dca455f-d4fd-44bc-a04d-ded950741f76"}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:00:52.493940 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0bb64d3a-747e-4190-aa4b-570ac8dbeaf5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:52.500503 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0bb64d3a-747e-4190-aa4b-570ac8dbeaf5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:52.500921 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0bb64d3a-747e-4190-aa4b-570ac8dbeaf5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:52.501686 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0bb64d3a-747e-4190-aa4b-570ac8dbeaf5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:52.502160 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0bb64d3a-747e-4190-aa4b-570ac8dbeaf5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:52.584972 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-0bb64d3a-747e-4190-aa4b-570ac8dbeaf5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] HTTP exception thrown: Invalid volume: volume 6dca455f-d4fd-44bc-a04d-ded950741f76 is already attached to instances: 70a0babe-e62d-4dd3-8642-7c049a6236a3 May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0bb64d3a-747e-4190-aa4b-570ac8dbeaf5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Request method failure captured: May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: POST /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7/os-volume_attachments HTTP/1.1 May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 74 May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkOaNMspd4aouSbU1AbWPRZXQpnMIXaZVnqXM_GcJU5QANUYoykKOboFENZqE39ayR7YV98XzJEhmbNMT4xGE2Rmi1LhcZy3xlCFBJXF3aSJNrYEmDnN6WznzrHbbYABEJ1DEPcIqWV1-In6s7XLRv6-66f2Fc-5c9Wz9_np-VTpkmg May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:00:52.586983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:00:52.588326 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}] May 25 15:00:52.588326 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-AttachVolumeNegativeTest-533430010 May 25 15:00:52.588326 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:00:52.588326 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:00:52.588326 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:00:52.588326 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:00:52.588326 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:00:52.588326 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: e60a5e751f22450c8e366c85b37af1f6 May 25 15:00:52.588326 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:00:52.588326 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: May 25 15:00:52.588326 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {"volumeAttachment": {"volumeId": "6dca455f-d4fd-44bc-a04d-ded950741f76"}} May 25 15:00:52.588326 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Invalid volume: volume 6dca455f-d4fd-44bc-a04d-ded950741f76 is already attached to instances: 70a0babe-e62d-4dd3-8642-7c049a6236a3 May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'server_id': 'f150bd82-8a04-4a33-bebd-594f65f1d6a7', 'body': {'volumeAttachment': {'volumeId': '6dca455f-d4fd-44bc-a04d-ded950741f76'}}} May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6dca455f-d4fd-44bc-a04d-ded950741f76 is already attached to instances: 70a0babe-e62d-4dd3-8642-7c049a6236a3 May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:00:52.589091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6dca455f-d4fd-44bc-a04d-ded950741f76 is already attached to instances: 70a0babe-e62d-4dd3-8642-7c049a6236a3 May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:00:52.590329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:00:52.591570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:00:52.591570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:00:52.591570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:00:52.591570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6dca455f-d4fd-44bc-a04d-ded950741f76 is already attached to instances: 70a0babe-e62d-4dd3-8642-7c049a6236a3 May 25 15:00:52.591570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:00:52.591570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0bb64d3a-747e-4190-aa4b-570ac8dbeaf5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Returning 400 to user: Invalid volume: volume 6dca455f-d4fd-44bc-a04d-ded950741f76 is already attached to instances: 70a0babe-e62d-4dd3-8642-7c049a6236a3 {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:00:52.591570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0bb64d3a-747e-4190-aa4b-570ac8dbeaf5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "POST /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100287 May 25 15:00:52.591570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 223/456] 10.222.0.78 () {60 vars in 1322 bytes} [Wed May 25 15:00:52 2022] POST /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 15:00:52.597471 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-1ad3e3c0-fd2e-4985-9786-413c644ed71d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:52.597975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-1ad3e3c0-fd2e-4985-9786-413c644ed71d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:52.605030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1ad3e3c0-fd2e-4985-9786-413c644ed71d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:52.605490 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1ad3e3c0-fd2e-4985-9786-413c644ed71d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:52.606309 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1ad3e3c0-fd2e-4985-9786-413c644ed71d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:52.606744 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1ad3e3c0-fd2e-4985-9786-413c644ed71d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:52.615165 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d6f78dc8-c665-4a77-88a7-e9a9e00d4693 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:52.616361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d6f78dc8-c665-4a77-88a7-e9a9e00d4693 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:52.623949 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d6f78dc8-c665-4a77-88a7-e9a9e00d4693 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:52.624407 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d6f78dc8-c665-4a77-88a7-e9a9e00d4693 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:52.625190 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d6f78dc8-c665-4a77-88a7-e9a9e00d4693 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:52.625628 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d6f78dc8-c665-4a77-88a7-e9a9e00d4693 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:52.637350 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-1ad3e3c0-fd2e-4985-9786-413c644ed71d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Going to try to terminate instance {{(pid=124523) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:00:52.723346 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-1ad3e3c0-fd2e-4985-9786-413c644ed71d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 204 len: 0 microversion: 2.1 time: 0.129419 May 25 15:00:52.724146 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 234/457] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:00:52 2022] DELETE /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:00:52.734995 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-516ed17b-1ad4-4de0-9a63-06345aa96014 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:52.734995 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-516ed17b-1ad4-4de0-9a63-06345aa96014 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:52.741987 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-516ed17b-1ad4-4de0-9a63-06345aa96014 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:52.742414 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-516ed17b-1ad4-4de0-9a63-06345aa96014 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:52.743194 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-516ed17b-1ad4-4de0-9a63-06345aa96014 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:52.743631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-516ed17b-1ad4-4de0-9a63-06345aa96014 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:52.769299 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d6f78dc8-c665-4a77-88a7-e9a9e00d4693 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:52.777449 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d6f78dc8-c665-4a77-88a7-e9a9e00d4693 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1674 microversion: 2.1 time: 0.166130 May 25 15:00:52.778370 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 224/458] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:52 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:00:52.876937 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-516ed17b-1ad4-4de0-9a63-06345aa96014 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:52.884607 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-516ed17b-1ad4-4de0-9a63-06345aa96014 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1681 microversion: 2.1 time: 0.156125 May 25 15:00:52.885524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 235/459] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:52 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:00:53.348838 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0b9a682e-3132-4c8c-8f15-abedd5a6a1be tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20855e94-0219-403a-87ff-754990affb7e"}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:00:53.349954 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0b9a682e-3132-4c8c-8f15-abedd5a6a1be tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:53.356042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0b9a682e-3132-4c8c-8f15-abedd5a6a1be tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:53.356490 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0b9a682e-3132-4c8c-8f15-abedd5a6a1be tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:53.357253 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0b9a682e-3132-4c8c-8f15-abedd5a6a1be tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:53.357745 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0b9a682e-3132-4c8c-8f15-abedd5a6a1be tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:53.794638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-9e309479-acf3-4865-8e9f-14878a7ec09c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:53.795253 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-9e309479-acf3-4865-8e9f-14878a7ec09c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:53.801359 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9e309479-acf3-4865-8e9f-14878a7ec09c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:53.801810 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9e309479-acf3-4865-8e9f-14878a7ec09c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:53.802601 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9e309479-acf3-4865-8e9f-14878a7ec09c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:53.803042 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9e309479-acf3-4865-8e9f-14878a7ec09c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:53.942802 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-9e309479-acf3-4865-8e9f-14878a7ec09c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:53.951475 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-9e309479-acf3-4865-8e9f-14878a7ec09c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1674 microversion: 2.1 time: 0.160452 May 25 15:00:53.953425 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 236/460] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:53 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:00:53.958381 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8ae984a3-4f2d-4469-9271-bb74abdd4baf tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:53.958989 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8ae984a3-4f2d-4469-9271-bb74abdd4baf tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:53.965467 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8ae984a3-4f2d-4469-9271-bb74abdd4baf tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:53.965915 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8ae984a3-4f2d-4469-9271-bb74abdd4baf tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:53.966725 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8ae984a3-4f2d-4469-9271-bb74abdd4baf tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:53.967158 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8ae984a3-4f2d-4469-9271-bb74abdd4baf tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:54.102705 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8ae984a3-4f2d-4469-9271-bb74abdd4baf tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:54.110651 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8ae984a3-4f2d-4469-9271-bb74abdd4baf tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1681 microversion: 2.1 time: 0.156185 May 25 15:00:54.111224 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 237/461] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:53 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:54.971876 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-6cabe014-0e3e-41e3-80fe-e935b86705b0 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:54.972547 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-6cabe014-0e3e-41e3-80fe-e935b86705b0 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:54.978638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6cabe014-0e3e-41e3-80fe-e935b86705b0 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:54.979089 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6cabe014-0e3e-41e3-80fe-e935b86705b0 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:54.979870 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6cabe014-0e3e-41e3-80fe-e935b86705b0 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:54.980362 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6cabe014-0e3e-41e3-80fe-e935b86705b0 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:55.161074 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-6cabe014-0e3e-41e3-80fe-e935b86705b0 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:55.169454 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-6cabe014-0e3e-41e3-80fe-e935b86705b0 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1651 microversion: 2.1 time: 0.201415 May 25 15:00:55.170102 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 238/462] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:54 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1651 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:00:55.179023 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-886ee5af-e4bf-4266-8956-3de967cedede tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:55.179023 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-886ee5af-e4bf-4266-8956-3de967cedede tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:55.183644 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-886ee5af-e4bf-4266-8956-3de967cedede tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:55.184096 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-886ee5af-e4bf-4266-8956-3de967cedede tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:55.184838 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-886ee5af-e4bf-4266-8956-3de967cedede tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:55.185308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-886ee5af-e4bf-4266-8956-3de967cedede tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:55.267270 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0b9a682e-3132-4c8c-8f15-abedd5a6a1be tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "POST /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.922248 May 25 15:00:55.269483 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 225/463] 10.222.0.78 () {60 vars in 1322 bytes} [Wed May 25 15:00:53 2022] POST /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/os-volume_attachments => generated 194 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:00:55.277654 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7ea4e6d6-e649-4bc2-a211-5b8139477edd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:00:55.287497 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7ea4e6d6-e649-4bc2-a211-5b8139477edd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:55.287741 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7ea4e6d6-e649-4bc2-a211-5b8139477edd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:55.315742 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7ea4e6d6-e649-4bc2-a211-5b8139477edd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Going to try to start instance {{(pid=124524) start /opt/stack/nova/nova/compute/api.py:2730}} May 25 15:00:55.367621 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7ea4e6d6-e649-4bc2-a211-5b8139477edd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "POST /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912/action" status: 202 len: 0 microversion: 2.1 time: 0.096088 May 25 15:00:55.368469 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 226/464] 10.222.0.78 () {60 vars in 1277 bytes} [Wed May 25 15:00:55 2022] POST /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:00:55.377515 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-3f91d716-bb1b-4c7f-9087-32616a8df0b4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:55.378248 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-3f91d716-bb1b-4c7f-9087-32616a8df0b4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:55.387619 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3f91d716-bb1b-4c7f-9087-32616a8df0b4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:55.388367 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3f91d716-bb1b-4c7f-9087-32616a8df0b4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:55.390069 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3f91d716-bb1b-4c7f-9087-32616a8df0b4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:55.390352 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3f91d716-bb1b-4c7f-9087-32616a8df0b4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:55.490155 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-886ee5af-e4bf-4266-8956-3de967cedede tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:55.500158 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-886ee5af-e4bf-4266-8956-3de967cedede tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1681 microversion: 2.1 time: 0.329037 May 25 15:00:55.510776 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 239/465] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:55 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1681 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:55.561371 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3f91d716-bb1b-4c7f-9087-32616a8df0b4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:55.577088 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-3f91d716-bb1b-4c7f-9087-32616a8df0b4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1660 microversion: 2.1 time: 0.197037 May 25 15:00:55.577088 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 227/466] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:55 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1660 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:00:56.365932 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-4ca5774d-ea64-48e3-8686-81b81207f632 req-b66f7442-d612-4008-b9f2-8217dc2f9f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f150bd82-8a04-4a33-bebd-594f65f1d6a7", "name": "network-vif-deleted", "tag": "bedd3cb1-f210-414d-ada2-ad2ffd6d01ae"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:00:56.380662 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-4ca5774d-ea64-48e3-8686-81b81207f632 req-b66f7442-d612-4008-b9f2-8217dc2f9f7a service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:56.381241 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-4ca5774d-ea64-48e3-8686-81b81207f632 req-b66f7442-d612-4008-b9f2-8217dc2f9f7a service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:56.394813 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-4ca5774d-ea64-48e3-8686-81b81207f632 req-b66f7442-d612-4008-b9f2-8217dc2f9f7a service nova] Creating event network-vif-deleted:bedd3cb1-f210-414d-ada2-ad2ffd6d01ae for instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 on hv-cinder-80382 May 25 15:00:56.401737 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-4ca5774d-ea64-48e3-8686-81b81207f632 req-b66f7442-d612-4008-b9f2-8217dc2f9f7a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039047 May 25 15:00:56.411103 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 240/467] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:00:56.518469 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8aaffbd8-0ef6-44e5-ae0e-acc7edf8a7f7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:56.519726 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-8aaffbd8-0ef6-44e5-ae0e-acc7edf8a7f7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:56.526990 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8aaffbd8-0ef6-44e5-ae0e-acc7edf8a7f7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:56.527687 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8aaffbd8-0ef6-44e5-ae0e-acc7edf8a7f7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:56.528634 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8aaffbd8-0ef6-44e5-ae0e-acc7edf8a7f7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:56.529220 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8aaffbd8-0ef6-44e5-ae0e-acc7edf8a7f7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:56.590307 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a8873d76-699f-4897-ad0a-b73e15144d1b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:56.591305 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a8873d76-699f-4897-ad0a-b73e15144d1b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:56.605770 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a8873d76-699f-4897-ad0a-b73e15144d1b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:56.606462 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a8873d76-699f-4897-ad0a-b73e15144d1b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:56.607421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a8873d76-699f-4897-ad0a-b73e15144d1b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:56.608033 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a8873d76-699f-4897-ad0a-b73e15144d1b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:56.612690 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:56.645824 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-8aaffbd8-0ef6-44e5-ae0e-acc7edf8a7f7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:56.657252 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-8aaffbd8-0ef6-44e5-ae0e-acc7edf8a7f7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1326 microversion: 2.1 time: 0.142149 May 25 15:00:56.658453 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 228/468] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:56 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1326 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:56.789713 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a8873d76-699f-4897-ad0a-b73e15144d1b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:56.797826 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a8873d76-699f-4897-ad0a-b73e15144d1b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1660 microversion: 2.1 time: 0.212373 May 25 15:00:56.798648 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 241/469] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:56 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1660 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:57.675213 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-f1c4ac8b-00ab-4cf5-bd2b-9e749dd9278a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:57.675820 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-f1c4ac8b-00ab-4cf5-bd2b-9e749dd9278a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:57.682597 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f1c4ac8b-00ab-4cf5-bd2b-9e749dd9278a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:57.683053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f1c4ac8b-00ab-4cf5-bd2b-9e749dd9278a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:57.683861 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f1c4ac8b-00ab-4cf5-bd2b-9e749dd9278a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:57.684296 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f1c4ac8b-00ab-4cf5-bd2b-9e749dd9278a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:57.688824 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:57.729026 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f1c4ac8b-00ab-4cf5-bd2b-9e749dd9278a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:57.729474 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f1c4ac8b-00ab-4cf5-bd2b-9e749dd9278a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:57.729930 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-f1c4ac8b-00ab-4cf5-bd2b-9e749dd9278a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lazy-loading 'fault' on Instance uuid f150bd82-8a04-4a33-bebd-594f65f1d6a7 {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:00:57.774138 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-f1c4ac8b-00ab-4cf5-bd2b-9e749dd9278a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:57.782341 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-f1c4ac8b-00ab-4cf5-bd2b-9e749dd9278a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 200 len: 1331 microversion: 2.1 time: 0.110909 May 25 15:00:57.782913 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 229/470] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:57 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:57.816256 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ba360cdf-3146-4b4b-93ba-83b53dec704b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:57.816962 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ba360cdf-3146-4b4b-93ba-83b53dec704b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:57.823265 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ba360cdf-3146-4b4b-93ba-83b53dec704b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:57.823705 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ba360cdf-3146-4b4b-93ba-83b53dec704b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:57.824475 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ba360cdf-3146-4b4b-93ba-83b53dec704b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:57.824900 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ba360cdf-3146-4b4b-93ba-83b53dec704b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:57.999611 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ba360cdf-3146-4b4b-93ba-83b53dec704b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:58.007445 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ba360cdf-3146-4b4b-93ba-83b53dec704b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1664 microversion: 2.1 time: 0.195074 May 25 15:00:58.008010 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 242/471] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:57 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1664 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:58.801136 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-9b4d99c4-da44-48c5-9301-e6b57846b5f8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:58.801726 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-9b4d99c4-da44-48c5-9301-e6b57846b5f8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:58.808905 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9b4d99c4-da44-48c5-9301-e6b57846b5f8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:58.809352 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9b4d99c4-da44-48c5-9301-e6b57846b5f8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:58.810193 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9b4d99c4-da44-48c5-9301-e6b57846b5f8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:58.810627 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9b4d99c4-da44-48c5-9301-e6b57846b5f8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:58.825929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-9b4d99c4-da44-48c5-9301-e6b57846b5f8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] HTTP exception thrown: Instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 could not be found. May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-9b4d99c4-da44-48c5-9301-e6b57846b5f8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Request method failure captured: May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 HTTP/1.1 May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkOaNMspd4aouSbU1AbWPRZXQpnMIXaZVnqXM_GcJU5QANUYoykKOboFENZqE39ayR7YV98XzJEhmbNMT4xGE2Rmi1LhcZy3xlCFBJXF3aSJNrYEmDnN6WznzrHbbYABEJ1DEPcIqWV1-In6s7XLRv6-66f2Fc-5c9Wz9_np-VTpkmg May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:00:58.827635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:00:58.829531 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}] May 25 15:00:58.829531 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-AttachVolumeNegativeTest-533430010 May 25 15:00:58.829531 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:00:58.829531 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:00:58.829531 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:00:58.829531 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:00:58.829531 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:00:58.829531 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: e60a5e751f22450c8e366c85b37af1f6 May 25 15:00:58.829531 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:00:58.829531 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:00:58.829531 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 could not be found. May 25 15:00:58.829531 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': 'f150bd82-8a04-4a33-bebd-594f65f1d6a7'} May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 could not be found. May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:00:58.830860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:00:58.833743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:00:58.833743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:00:58.833743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:00:58.833743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:00:58.833743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:00:58.833743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:00:58.833743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:00:58.833743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 could not be found. May 25 15:00:58.833743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:00:58.833743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:00:58.833743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:00:58.833743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:00:58.833743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:00:58.833743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:00:58.833743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:00:58.833743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:00:58.833743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 could not be found. May 25 15:00:58.833743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:00:58.836262 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-9b4d99c4-da44-48c5-9301-e6b57846b5f8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Returning 404 to user: Instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:00:58.836262 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-9b4d99c4-da44-48c5-9301-e6b57846b5f8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 404 len: 111 microversion: 2.1 time: 0.033104 May 25 15:00:58.836262 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 230/472] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:00:58 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:00:58.845819 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8c489241-2984-4568-927a-89efc631380b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '.version_select at 0x7fb1e00c4310>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:58.875084 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8c489241-2984-4568-927a-89efc631380b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-244457338" status: 202 len: 0 microversion: 2.1 time: 0.036618 May 25 15:00:58.879830 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 243/473] 10.222.0.78 () {58 vars in 1217 bytes} [Wed May 25 15:00:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-244457338 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:00:59.619475 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6f77596a-7150-4ab7-b284-062a0b58c0c9 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:59.619967 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6f77596a-7150-4ab7-b284-062a0b58c0c9 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:59.626225 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6f77596a-7150-4ab7-b284-062a0b58c0c9 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:59.626677 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6f77596a-7150-4ab7-b284-062a0b58c0c9 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:59.627445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6f77596a-7150-4ab7-b284-062a0b58c0c9 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:59.627881 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6f77596a-7150-4ab7-b284-062a0b58c0c9 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:59.763213 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-6f77596a-7150-4ab7-b284-062a0b58c0c9 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lazy-loading 'services' on Instance uuid 70a0babe-e62d-4dd3-8642-7c049a6236a3 {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:00:59.879452 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6f77596a-7150-4ab7-b284-062a0b58c0c9 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "DELETE /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3/os-volume_attachments/6dca455f-d4fd-44bc-a04d-ded950741f76" status: 202 len: 0 microversion: 2.1 time: 0.263807 May 25 15:00:59.880537 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 231/474] 10.222.0.78 () {58 vars in 1415 bytes} [Wed May 25 15:00:59 2022] DELETE /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3/os-volume_attachments/6dca455f-d4fd-44bc-a04d-ded950741f76 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:00:59.889377 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0d045f9f-d869-432c-ad97-b03c601374ca tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:59.890351 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-0d045f9f-d869-432c-ad97-b03c601374ca tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:59.900999 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0d045f9f-d869-432c-ad97-b03c601374ca tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:59.901968 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0d045f9f-d869-432c-ad97-b03c601374ca tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:59.902977 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0d045f9f-d869-432c-ad97-b03c601374ca tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:59.903412 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0d045f9f-d869-432c-ad97-b03c601374ca tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:59.937018 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-0d045f9f-d869-432c-ad97-b03c601374ca tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052038 May 25 15:00:59.937573 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 244/475] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:00:59 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:00.949938 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0274ac78-8325-4f0e-9b74-e90e6d816eb8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:00.951081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0274ac78-8325-4f0e-9b74-e90e6d816eb8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:00.959555 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0274ac78-8325-4f0e-9b74-e90e6d816eb8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:00.960011 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0274ac78-8325-4f0e-9b74-e90e6d816eb8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:00.960800 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0274ac78-8325-4f0e-9b74-e90e6d816eb8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:00.961239 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0274ac78-8325-4f0e-9b74-e90e6d816eb8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:00.993436 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0274ac78-8325-4f0e-9b74-e90e6d816eb8 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048261 May 25 15:01:00.994028 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 232/476] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:01:00 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:02.004405 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b2652190-46ca-4e20-900d-797047c03bf6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:02.005326 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-b2652190-46ca-4e20-900d-797047c03bf6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:02.013629 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b2652190-46ca-4e20-900d-797047c03bf6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:02.014116 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b2652190-46ca-4e20-900d-797047c03bf6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:02.014890 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b2652190-46ca-4e20-900d-797047c03bf6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:02.015318 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b2652190-46ca-4e20-900d-797047c03bf6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:02.044226 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-b2652190-46ca-4e20-900d-797047c03bf6 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043785 May 25 15:01:02.044778 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 245/477] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:01:01 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:02.831570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-dab79673-2576-4993-bf6f-3765138b2f43 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:02.832519 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-dab79673-2576-4993-bf6f-3765138b2f43 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:02.839765 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dab79673-2576-4993-bf6f-3765138b2f43 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:02.840215 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dab79673-2576-4993-bf6f-3765138b2f43 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:02.840991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dab79673-2576-4993-bf6f-3765138b2f43 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:02.841424 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dab79673-2576-4993-bf6f-3765138b2f43 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:02.867424 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-dab79673-2576-4993-bf6f-3765138b2f43 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lazy-loading 'flavor' on Instance uuid 58a68392-711b-4106-990e-f6ad82525d59 {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:01:03.056760 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-fe903d51-cb74-407e-9260-2d10c373c968 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:03.058393 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-fe903d51-cb74-407e-9260-2d10c373c968 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:03.064711 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fe903d51-cb74-407e-9260-2d10c373c968 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:03.065166 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fe903d51-cb74-407e-9260-2d10c373c968 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:03.065949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fe903d51-cb74-407e-9260-2d10c373c968 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:03.066436 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fe903d51-cb74-407e-9260-2d10c373c968 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:03.098842 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-fe903d51-cb74-407e-9260-2d10c373c968 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046849 May 25 15:01:03.100343 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 246/478] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:01:03 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:01:03.219833 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-dab79673-2576-4993-bf6f-3765138b2f43 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "POST /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/action" status: 200 len: 32 microversion: 2.1 time: 0.392175 May 25 15:01:03.220522 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 233/479] 10.222.0.78 () {60 vars in 1277 bytes} [Wed May 25 15:01:02 2022] POST /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/action => generated 32 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:01:03.229464 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-7d1b051d-4dab-40e1-ab8f-352c9643ccaf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:03.230238 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-7d1b051d-4dab-40e1-ab8f-352c9643ccaf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:03.236521 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7d1b051d-4dab-40e1-ab8f-352c9643ccaf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:03.236977 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7d1b051d-4dab-40e1-ab8f-352c9643ccaf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:03.237751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7d1b051d-4dab-40e1-ab8f-352c9643ccaf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:03.238224 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7d1b051d-4dab-40e1-ab8f-352c9643ccaf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:03.517181 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-7d1b051d-4dab-40e1-ab8f-352c9643ccaf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:03.526301 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-7d1b051d-4dab-40e1-ab8f-352c9643ccaf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1733 microversion: 2.1 time: 0.300512 May 25 15:01:03.526882 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 247/480] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:03 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1733 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:04.112049 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-5e3ec41a-f84e-4d4d-88a7-29d8db1fb803 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:04.113337 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-5e3ec41a-f84e-4d4d-88a7-29d8db1fb803 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:04.120773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5e3ec41a-f84e-4d4d-88a7-29d8db1fb803 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:04.121221 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5e3ec41a-f84e-4d4d-88a7-29d8db1fb803 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:04.122000 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5e3ec41a-f84e-4d4d-88a7-29d8db1fb803 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:04.122466 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5e3ec41a-f84e-4d4d-88a7-29d8db1fb803 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:04.154378 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-5e3ec41a-f84e-4d4d-88a7-29d8db1fb803 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047589 May 25 15:01:04.154931 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 234/481] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:01:04 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:01:04.218531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-de79f9ca-f152-45b0-a9ef-aafdec9cc986 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:04.219089 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-de79f9ca-f152-45b0-a9ef-aafdec9cc986 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:04.225884 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-de79f9ca-f152-45b0-a9ef-aafdec9cc986 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:04.226357 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-de79f9ca-f152-45b0-a9ef-aafdec9cc986 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:04.227138 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-de79f9ca-f152-45b0-a9ef-aafdec9cc986 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:04.227574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-de79f9ca-f152-45b0-a9ef-aafdec9cc986 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:04.254473 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-de79f9ca-f152-45b0-a9ef-aafdec9cc986 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Going to try to terminate instance {{(pid=124523) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:01:04.331434 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-de79f9ca-f152-45b0-a9ef-aafdec9cc986 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "DELETE /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 204 len: 0 microversion: 2.1 time: 0.116890 May 25 15:01:04.332013 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 248/482] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:01:04 2022] DELETE /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:01:04.340286 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-c3c6f7a5-7601-44ee-8e80-8e0b9c84c7b2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:04.340900 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-c3c6f7a5-7601-44ee-8e80-8e0b9c84c7b2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:04.347179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c3c6f7a5-7601-44ee-8e80-8e0b9c84c7b2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:04.347849 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c3c6f7a5-7601-44ee-8e80-8e0b9c84c7b2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:04.348641 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c3c6f7a5-7601-44ee-8e80-8e0b9c84c7b2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:04.349071 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c3c6f7a5-7601-44ee-8e80-8e0b9c84c7b2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:04.484867 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-c3c6f7a5-7601-44ee-8e80-8e0b9c84c7b2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:04.493272 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-c3c6f7a5-7601-44ee-8e80-8e0b9c84c7b2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1683 microversion: 2.1 time: 0.156926 May 25 15:01:04.493856 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 235/483] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:04 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:04.544173 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-af1fa4cb-83b8-4e69-aaa1-701bee73392c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:04.544877 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-af1fa4cb-83b8-4e69-aaa1-701bee73392c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:04.550985 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-af1fa4cb-83b8-4e69-aaa1-701bee73392c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:04.551437 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-af1fa4cb-83b8-4e69-aaa1-701bee73392c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:04.552209 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-af1fa4cb-83b8-4e69-aaa1-701bee73392c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:04.553175 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-af1fa4cb-83b8-4e69-aaa1-701bee73392c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:04.691461 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-af1fa4cb-83b8-4e69-aaa1-701bee73392c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:04.700927 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-af1fa4cb-83b8-4e69-aaa1-701bee73392c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1733 microversion: 2.1 time: 0.160866 May 25 15:01:04.701518 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 249/484] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:04 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:05.512903 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-ab39004f-c523-4785-9bd5-d540221bca08 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:05.513546 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-ab39004f-c523-4785-9bd5-d540221bca08 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:05.520588 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ab39004f-c523-4785-9bd5-d540221bca08 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:05.521042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ab39004f-c523-4785-9bd5-d540221bca08 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:05.521854 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ab39004f-c523-4785-9bd5-d540221bca08 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:05.522320 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ab39004f-c523-4785-9bd5-d540221bca08 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:05.666483 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-ab39004f-c523-4785-9bd5-d540221bca08 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:05.674273 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-ab39004f-c523-4785-9bd5-d540221bca08 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1683 microversion: 2.1 time: 0.165479 May 25 15:01:05.674838 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 236/485] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:05 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:05.718640 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ea748118-8398-4215-a7f4-ffebd911dfdc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:05.719281 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ea748118-8398-4215-a7f4-ffebd911dfdc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:05.725386 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ea748118-8398-4215-a7f4-ffebd911dfdc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:05.725832 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ea748118-8398-4215-a7f4-ffebd911dfdc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:05.726622 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ea748118-8398-4215-a7f4-ffebd911dfdc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:05.727075 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ea748118-8398-4215-a7f4-ffebd911dfdc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:05.855114 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ea748118-8398-4215-a7f4-ffebd911dfdc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:05.863133 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ea748118-8398-4215-a7f4-ffebd911dfdc tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1733 microversion: 2.1 time: 0.148375 May 25 15:01:05.863698 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 250/486] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:05 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:06.691924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-aa57418b-2b4e-41a0-b952-44ff94b58a78 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:06.692544 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-aa57418b-2b4e-41a0-b952-44ff94b58a78 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:06.699057 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aa57418b-2b4e-41a0-b952-44ff94b58a78 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:06.699504 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aa57418b-2b4e-41a0-b952-44ff94b58a78 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:06.700267 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aa57418b-2b4e-41a0-b952-44ff94b58a78 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:06.700704 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aa57418b-2b4e-41a0-b952-44ff94b58a78 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:06.838621 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-aa57418b-2b4e-41a0-b952-44ff94b58a78 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:06.846209 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-aa57418b-2b4e-41a0-b952-44ff94b58a78 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1683 microversion: 2.1 time: 0.158129 May 25 15:01:06.846785 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 237/487] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:06 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:06.880289 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-29d87d64-56b4-4893-ab7a-a17e5b2b7088 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:06.880829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-29d87d64-56b4-4893-ab7a-a17e5b2b7088 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:06.884807 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:06.893039 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-29d87d64-56b4-4893-ab7a-a17e5b2b7088 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:06.893492 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-29d87d64-56b4-4893-ab7a-a17e5b2b7088 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:06.894298 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-29d87d64-56b4-4893-ab7a-a17e5b2b7088 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:06.894735 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-29d87d64-56b4-4893-ab7a-a17e5b2b7088 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:07.031063 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-29d87d64-56b4-4893-ab7a-a17e5b2b7088 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:07.039849 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-29d87d64-56b4-4893-ab7a-a17e5b2b7088 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1733 microversion: 2.1 time: 0.163433 May 25 15:01:07.040432 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 251/488] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:06 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:07.865972 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-26bfd3ac-5769-431c-95f2-1738ad044b24 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:07.867325 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-26bfd3ac-5769-431c-95f2-1738ad044b24 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:07.874819 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-26bfd3ac-5769-431c-95f2-1738ad044b24 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:07.875272 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-26bfd3ac-5769-431c-95f2-1738ad044b24 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:07.876154 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-26bfd3ac-5769-431c-95f2-1738ad044b24 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:07.876586 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-26bfd3ac-5769-431c-95f2-1738ad044b24 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:07.963360 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-26bfd3ac-5769-431c-95f2-1738ad044b24 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:07.972479 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-26bfd3ac-5769-431c-95f2-1738ad044b24 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1615 microversion: 2.1 time: 0.111852 May 25 15:01:07.973521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 238/489] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:07 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1615 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:08.057959 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-36b983c1-dac9-49ba-bbd2-053b9386c62a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:08.058924 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-36b983c1-dac9-49ba-bbd2-053b9386c62a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:08.065811 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-36b983c1-dac9-49ba-bbd2-053b9386c62a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:08.066372 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-36b983c1-dac9-49ba-bbd2-053b9386c62a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:08.067178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-36b983c1-dac9-49ba-bbd2-053b9386c62a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:08.067618 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-36b983c1-dac9-49ba-bbd2-053b9386c62a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:08.184714 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-448364a5-65c5-4b0f-8433-7a565a5fa087 req-fcff6867-858a-4ba9-a3f7-8bbae6985f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a0babe-e62d-4dd3-8642-7c049a6236a3", "name": "network-vif-deleted", "tag": "16bf1466-e269-4b11-ae5a-74bda30dcb22"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:08.196199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-448364a5-65c5-4b0f-8433-7a565a5fa087 req-fcff6867-858a-4ba9-a3f7-8bbae6985f51 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:08.196786 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-448364a5-65c5-4b0f-8433-7a565a5fa087 req-fcff6867-858a-4ba9-a3f7-8bbae6985f51 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:08.210510 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-448364a5-65c5-4b0f-8433-7a565a5fa087 req-fcff6867-858a-4ba9-a3f7-8bbae6985f51 service nova] Creating event network-vif-deleted:16bf1466-e269-4b11-ae5a-74bda30dcb22 for instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 on hv-cinder-80382 May 25 15:01:08.216022 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-448364a5-65c5-4b0f-8433-7a565a5fa087 req-fcff6867-858a-4ba9-a3f7-8bbae6985f51 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038949 May 25 15:01:08.217028 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 239/490] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:08.263745 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-36b983c1-dac9-49ba-bbd2-053b9386c62a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:08.279682 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-36b983c1-dac9-49ba-bbd2-053b9386c62a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1733 microversion: 2.1 time: 0.225480 May 25 15:01:08.280278 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 252/491] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:08 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1733 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:08.992131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-4d547471-0b33-40b0-a42e-c6a4bd6b4080 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:08.992872 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-4d547471-0b33-40b0-a42e-c6a4bd6b4080 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:08.995424 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=51 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:09.002082 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4d547471-0b33-40b0-a42e-c6a4bd6b4080 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:09.002528 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4d547471-0b33-40b0-a42e-c6a4bd6b4080 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:09.003491 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4d547471-0b33-40b0-a42e-c6a4bd6b4080 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:09.004108 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4d547471-0b33-40b0-a42e-c6a4bd6b4080 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:09.045149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4d547471-0b33-40b0-a42e-c6a4bd6b4080 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:09.045659 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4d547471-0b33-40b0-a42e-c6a4bd6b4080 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:09.046247 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-4d547471-0b33-40b0-a42e-c6a4bd6b4080 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lazy-loading 'fault' on Instance uuid 70a0babe-e62d-4dd3-8642-7c049a6236a3 {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:01:09.101833 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-4d547471-0b33-40b0-a42e-c6a4bd6b4080 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:09.109886 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-4d547471-0b33-40b0-a42e-c6a4bd6b4080 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 200 len: 1332 microversion: 2.1 time: 0.122455 May 25 15:01:09.110636 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 240/492] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:08 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 1332 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:09.300132 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-cfccef61-5db4-44d7-a2f1-1423836c4ae4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:09.301129 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-cfccef61-5db4-44d7-a2f1-1423836c4ae4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:09.307413 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cfccef61-5db4-44d7-a2f1-1423836c4ae4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:09.307897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cfccef61-5db4-44d7-a2f1-1423836c4ae4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:09.308674 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cfccef61-5db4-44d7-a2f1-1423836c4ae4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:09.309113 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cfccef61-5db4-44d7-a2f1-1423836c4ae4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:09.455469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-cfccef61-5db4-44d7-a2f1-1423836c4ae4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:09.464086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-cfccef61-5db4-44d7-a2f1-1423836c4ae4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1733 microversion: 2.1 time: 0.167957 May 25 15:01:09.464659 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 253/493] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:09 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:10.127685 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-83438840-225d-4b6e-ad4d-f16ee575d28b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:10.128490 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-83438840-225d-4b6e-ad4d-f16ee575d28b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:10.136113 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-83438840-225d-4b6e-ad4d-f16ee575d28b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:10.136555 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-83438840-225d-4b6e-ad4d-f16ee575d28b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:10.137342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-83438840-225d-4b6e-ad4d-f16ee575d28b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:10.137859 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-83438840-225d-4b6e-ad4d-f16ee575d28b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:10.154460 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-83438840-225d-4b6e-ad4d-f16ee575d28b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] HTTP exception thrown: Instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 could not be found. May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-83438840-225d-4b6e-ad4d-f16ee575d28b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Request method failure captured: May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 HTTP/1.1 May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkOaNMspd4aouSbU1AbWPRZXQpnMIXaZVnqXM_GcJU5QANUYoykKOboFENZqE39ayR7YV98XzJEhmbNMT4xGE2Rmi1LhcZy3xlCFBJXF3aSJNrYEmDnN6WznzrHbbYABEJ1DEPcIqWV1-In6s7XLRv6-66f2Fc-5c9Wz9_np-VTpkmg May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:01:10.156111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:01:10.158201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}] May 25 15:01:10.158201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-AttachVolumeNegativeTest-533430010 May 25 15:01:10.158201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:01:10.158201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:01:10.158201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:01:10.158201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:01:10.158201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:01:10.158201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: e60a5e751f22450c8e366c85b37af1f6 May 25 15:01:10.158201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:01:10.158201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:01:10.158201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 could not be found. May 25 15:01:10.158201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': '70a0babe-e62d-4dd3-8642-7c049a6236a3'} May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 could not be found. May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:01:10.159348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:01:10.161245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:01:10.161245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:01:10.161245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:01:10.161245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:01:10.161245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:01:10.161245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:01:10.161245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:01:10.161245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 could not be found. May 25 15:01:10.161245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:01:10.161245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:01:10.161245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:01:10.161245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:10.161245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:01:10.161245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:01:10.161245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:01:10.161245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:01:10.161245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 could not be found. May 25 15:01:10.161245 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:01:10.164335 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-83438840-225d-4b6e-ad4d-f16ee575d28b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Returning 404 to user: Instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:01:10.164335 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-83438840-225d-4b6e-ad4d-f16ee575d28b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 404 len: 111 microversion: 2.1 time: 0.033831 May 25 15:01:10.164335 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 241/494] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:10 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:01:10.167725 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-554bd8a5-e053-47b1-a330-ab95d11564b3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '.version_select at 0x7fb1e0086b80>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:10.193688 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-554bd8a5-e053-47b1-a330-ab95d11564b3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1328946574" status: 202 len: 0 microversion: 2.1 time: 0.029082 May 25 15:01:10.198798 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 254/495] 10.222.0.78 () {58 vars in 1220 bytes} [Wed May 25 15:01:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1328946574 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:01:10.484526 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-988f4345-ad84-45a6-8ad2-6d4e549346f2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:10.485517 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-988f4345-ad84-45a6-8ad2-6d4e549346f2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:10.495335 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-988f4345-ad84-45a6-8ad2-6d4e549346f2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:10.496145 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-988f4345-ad84-45a6-8ad2-6d4e549346f2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:10.497079 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-988f4345-ad84-45a6-8ad2-6d4e549346f2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:10.497511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-988f4345-ad84-45a6-8ad2-6d4e549346f2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:10.723302 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-988f4345-ad84-45a6-8ad2-6d4e549346f2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:10.732276 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-988f4345-ad84-45a6-8ad2-6d4e549346f2 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1733 microversion: 2.1 time: 0.254775 May 25 15:01:10.732847 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 242/496] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:10 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1733 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:10.948989 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-1b118db2-b084-4c7f-91fd-7c3284254b4a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Action: 'create', calling method: .version_select at 0x7fb1e00c4160>, body: {"keypair": {"name": "tempest-keypair-661729123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3Yersvm4ZCXhfXgtmfaxt1PfWye6UGgT5FLm+Fe+jWklwMFNYz9OmSX+38tbXAkryviJy1/8ZCTIxuj9uiODq9GP3ogUynFl73spEEZL0lbcqgkQUHKM8sUzEXZ18uyA=="}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:10.970282 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-1b118db2-b084-4c7f-91fd-7c3284254b4a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Getting quotas for project 9dafcd0df8524413b4fe81a0931323b1. Resources: {'key_pairs'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:01:10.975219 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-1b118db2-b084-4c7f-91fd-7c3284254b4a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Getting quotas for user e60a5e751f22450c8e366c85b37af1f6 and project 9dafcd0df8524413b4fe81a0931323b1. Resources: {'key_pairs'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:01:11.000098 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-1b118db2-b084-4c7f-91fd-7c3284254b4a tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057546 May 25 15:01:11.000690 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 255/497] 10.222.0.78 () {60 vars in 1158 bytes} [Wed May 25 15:01:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:11.750785 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-aff792bc-2257-41ee-a7ce-e7ead56cf1d7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:11.752048 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-aff792bc-2257-41ee-a7ce-e7ead56cf1d7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:11.758960 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aff792bc-2257-41ee-a7ce-e7ead56cf1d7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:11.759673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aff792bc-2257-41ee-a7ce-e7ead56cf1d7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:11.760661 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aff792bc-2257-41ee-a7ce-e7ead56cf1d7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:11.761097 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aff792bc-2257-41ee-a7ce-e7ead56cf1d7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:11.910612 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-aff792bc-2257-41ee-a7ce-e7ead56cf1d7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:11.919873 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-aff792bc-2257-41ee-a7ce-e7ead56cf1d7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1733 microversion: 2.1 time: 0.172419 May 25 15:01:11.930346 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 243/498] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:11 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:12.468709 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0ff7a9ee-132a-45ee-aad0-5d9a71e79d7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-165447481", "imageRef": "fbec7c78-0103-4632-9a21-d8e8056f2ce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c4b07fe-140a-4a0b-9f8f-030d2bf81125"}], "security_groups": [{"name": "tempest-securitygroup--559440409"}], "key_name": "tempest-keypair-661729123", "user_data": "}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:12.572872 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.network.neutron [None req-0ff7a9ee-132a-45ee-aad0-5d9a71e79d7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] validate_networks() for [('6c4b07fe-140a-4a0b-9f8f-030d2bf81125', None, None, None, None, None)] {{(pid=124523) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:01:12.938628 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-725f9b1a-614d-483b-94b3-9f8173950269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:12.939388 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-725f9b1a-614d-483b-94b3-9f8173950269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:12.962360 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-725f9b1a-614d-483b-94b3-9f8173950269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:12.962807 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-725f9b1a-614d-483b-94b3-9f8173950269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:12.963635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-725f9b1a-614d-483b-94b3-9f8173950269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:12.964034 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-725f9b1a-614d-483b-94b3-9f8173950269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:12.982789 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:13.010050 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-0ff7a9ee-132a-45ee-aad0-5d9a71e79d7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Flavor limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:01:13.010610 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-0ff7a9ee-132a-45ee-aad0-5d9a71e79d7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Image limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:01:13.011294 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-0ff7a9ee-132a-45ee-aad0-5d9a71e79d7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Flavor pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:01:13.011793 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-0ff7a9ee-132a-45ee-aad0-5d9a71e79d7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Image pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:01:13.012435 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-0ff7a9ee-132a-45ee-aad0-5d9a71e79d7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:01:13.022375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0ff7a9ee-132a-45ee-aad0-5d9a71e79d7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:13.022830 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0ff7a9ee-132a-45ee-aad0-5d9a71e79d7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:13.023710 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0ff7a9ee-132a-45ee-aad0-5d9a71e79d7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:13.024192 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0ff7a9ee-132a-45ee-aad0-5d9a71e79d7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:13.042639 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-0ff7a9ee-132a-45ee-aad0-5d9a71e79d7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Getting quotas for project 9dafcd0df8524413b4fe81a0931323b1. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:01:13.046909 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-0ff7a9ee-132a-45ee-aad0-5d9a71e79d7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Getting quotas for user e60a5e751f22450c8e366c85b37af1f6 and project 9dafcd0df8524413b4fe81a0931323b1. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:01:13.060127 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-0ff7a9ee-132a-45ee-aad0-5d9a71e79d7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Going to run 1 instances... {{(pid=124523) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:01:13.062407 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-0ff7a9ee-132a-45ee-aad0-5d9a71e79d7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbec7c78-0103-4632-9a21-d8e8056f2ce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:01:13.110760 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-725f9b1a-614d-483b-94b3-9f8173950269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:13.114315 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-0ff7a9ee-132a-45ee-aad0-5d9a71e79d7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.650534 May 25 15:01:13.115396 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 256/499] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 15:01:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:01:13.119861 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-725f9b1a-614d-483b-94b3-9f8173950269 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1733 microversion: 2.1 time: 0.185005 May 25 15:01:13.122110 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 244/500] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:12 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1733 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:01:13.129710 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-07be7b40-f800-47cd-8be7-c707938a3629 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:13.130701 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-07be7b40-f800-47cd-8be7-c707938a3629 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:13.190925 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-07be7b40-f800-47cd-8be7-c707938a3629 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:13.198880 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-07be7b40-f800-47cd-8be7-c707938a3629 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 200 len: 1240 microversion: 2.1 time: 0.073569 May 25 15:01:13.199560 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 257/501] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:13 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:14.137409 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-83773927-2474-41a2-a85c-5b1679e85dd6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:14.138042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-83773927-2474-41a2-a85c-5b1679e85dd6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:14.152821 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-83773927-2474-41a2-a85c-5b1679e85dd6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:14.153282 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-83773927-2474-41a2-a85c-5b1679e85dd6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:14.154093 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-83773927-2474-41a2-a85c-5b1679e85dd6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:14.154541 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-83773927-2474-41a2-a85c-5b1679e85dd6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:14.216577 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-415cac36-d05a-4355-b1f4-3e04f7fda2d1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:14.218128 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-415cac36-d05a-4355-b1f4-3e04f7fda2d1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:14.226245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-415cac36-d05a-4355-b1f4-3e04f7fda2d1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:14.226920 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-415cac36-d05a-4355-b1f4-3e04f7fda2d1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:14.228558 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-415cac36-d05a-4355-b1f4-3e04f7fda2d1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:14.230230 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-415cac36-d05a-4355-b1f4-3e04f7fda2d1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:14.292851 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-83773927-2474-41a2-a85c-5b1679e85dd6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:14.294961 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-415cac36-d05a-4355-b1f4-3e04f7fda2d1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:14.301016 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-83773927-2474-41a2-a85c-5b1679e85dd6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1733 microversion: 2.1 time: 0.167706 May 25 15:01:14.301584 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 245/502] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:14 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:14.303320 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-415cac36-d05a-4355-b1f4-3e04f7fda2d1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 200 len: 1292 microversion: 2.1 time: 0.090481 May 25 15:01:14.303885 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 258/503] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:14 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 1292 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:01:15.320091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2efb84e4-5743-4741-956c-b6bf8158e305 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:15.320842 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2efb84e4-5743-4741-956c-b6bf8158e305 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:15.321020 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a0f22ede-51e5-48b8-a307-33ede2f43da1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:15.321709 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a0f22ede-51e5-48b8-a307-33ede2f43da1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:15.327560 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2efb84e4-5743-4741-956c-b6bf8158e305 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:15.328135 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2efb84e4-5743-4741-956c-b6bf8158e305 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:15.328570 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a0f22ede-51e5-48b8-a307-33ede2f43da1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:15.329122 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2efb84e4-5743-4741-956c-b6bf8158e305 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:15.329263 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a0f22ede-51e5-48b8-a307-33ede2f43da1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:15.329745 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2efb84e4-5743-4741-956c-b6bf8158e305 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:15.330046 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a0f22ede-51e5-48b8-a307-33ede2f43da1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:15.330573 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a0f22ede-51e5-48b8-a307-33ede2f43da1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:15.409407 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a0f22ede-51e5-48b8-a307-33ede2f43da1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:15.417827 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a0f22ede-51e5-48b8-a307-33ede2f43da1 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 200 len: 1298 microversion: 2.1 time: 0.101295 May 25 15:01:15.418577 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 259/504] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:15 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:01:15.476956 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-2efb84e4-5743-4741-956c-b6bf8158e305 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:15.485075 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2efb84e4-5743-4741-956c-b6bf8158e305 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1733 microversion: 2.1 time: 0.169925 May 25 15:01:15.485734 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 246/505] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:15 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:16.269108 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-dd2093c4-5c65-4ffa-becc-2b605c7d8a7e req-14d8951f-4b3f-4435-a92b-a93cc68d526a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd834bb-ffdb-40c9-9585-cb81a52a3322", "tag": "f723a574-6986-4689-9b35-12c406a41e8e"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:16.286518 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-dd2093c4-5c65-4ffa-becc-2b605c7d8a7e req-14d8951f-4b3f-4435-a92b-a93cc68d526a service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:16.287737 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-dd2093c4-5c65-4ffa-becc-2b605c7d8a7e req-14d8951f-4b3f-4435-a92b-a93cc68d526a service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:16.301563 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-dd2093c4-5c65-4ffa-becc-2b605c7d8a7e req-14d8951f-4b3f-4435-a92b-a93cc68d526a service nova] Creating event network-changed:f723a574-6986-4689-9b35-12c406a41e8e for instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 on hv-cinder-80382 May 25 15:01:16.306922 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-dd2093c4-5c65-4ffa-becc-2b605c7d8a7e req-14d8951f-4b3f-4435-a92b-a93cc68d526a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041337 May 25 15:01:16.307620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 260/506] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:16.435553 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-93d158a3-5166-4aa8-8b47-b2d64397232f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:16.436169 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-93d158a3-5166-4aa8-8b47-b2d64397232f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:16.443040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-93d158a3-5166-4aa8-8b47-b2d64397232f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:16.443489 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-93d158a3-5166-4aa8-8b47-b2d64397232f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:16.444341 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-93d158a3-5166-4aa8-8b47-b2d64397232f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:16.444700 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-93d158a3-5166-4aa8-8b47-b2d64397232f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:16.503004 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-46a81286-42dd-4058-830d-c74061f65c62 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:16.504231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-46a81286-42dd-4058-830d-c74061f65c62 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:16.512105 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-46a81286-42dd-4058-830d-c74061f65c62 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:16.512823 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-46a81286-42dd-4058-830d-c74061f65c62 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:16.513617 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-46a81286-42dd-4058-830d-c74061f65c62 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:16.514084 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-46a81286-42dd-4058-830d-c74061f65c62 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:16.533438 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:16.585978 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-93d158a3-5166-4aa8-8b47-b2d64397232f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:16.596324 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-93d158a3-5166-4aa8-8b47-b2d64397232f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 200 len: 1365 microversion: 2.1 time: 0.164372 May 25 15:01:16.597581 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 247/507] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:16 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:16.730240 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-46a81286-42dd-4058-830d-c74061f65c62 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:16.738722 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-46a81286-42dd-4058-830d-c74061f65c62 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1733 microversion: 2.1 time: 0.240003 May 25 15:01:16.739827 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 261/508] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:16 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1733 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:17.615419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6d8f8365-5375-4cee-81a3-0e4674908e71 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:17.616059 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6d8f8365-5375-4cee-81a3-0e4674908e71 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:17.622679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6d8f8365-5375-4cee-81a3-0e4674908e71 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:17.623132 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6d8f8365-5375-4cee-81a3-0e4674908e71 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:17.623902 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6d8f8365-5375-4cee-81a3-0e4674908e71 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:17.624338 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6d8f8365-5375-4cee-81a3-0e4674908e71 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:17.763614 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6d8f8365-5375-4cee-81a3-0e4674908e71 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:17.771652 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6d8f8365-5375-4cee-81a3-0e4674908e71 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 200 len: 1365 microversion: 2.1 time: 0.160562 May 25 15:01:17.772207 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 248/509] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:17 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:17.862463 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4a97e033-8551-434b-bf9d-5c967b79814c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:17.863110 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4a97e033-8551-434b-bf9d-5c967b79814c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:17.869235 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4a97e033-8551-434b-bf9d-5c967b79814c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:17.869608 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4a97e033-8551-434b-bf9d-5c967b79814c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:17.870409 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4a97e033-8551-434b-bf9d-5c967b79814c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:17.870849 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4a97e033-8551-434b-bf9d-5c967b79814c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:18.009326 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4a97e033-8551-434b-bf9d-5c967b79814c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:18.017611 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4a97e033-8551-434b-bf9d-5c967b79814c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1733 microversion: 2.1 time: 0.265714 May 25 15:01:18.018367 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 262/510] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:17 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1733 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:01:18.788929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7c00c81a-5019-4a60-8e30-8a2007a40350 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:18.789799 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7c00c81a-5019-4a60-8e30-8a2007a40350 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:18.796747 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7c00c81a-5019-4a60-8e30-8a2007a40350 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:18.797102 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7c00c81a-5019-4a60-8e30-8a2007a40350 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:18.797917 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7c00c81a-5019-4a60-8e30-8a2007a40350 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:18.798387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7c00c81a-5019-4a60-8e30-8a2007a40350 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:18.931255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7c00c81a-5019-4a60-8e30-8a2007a40350 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:18.938781 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7c00c81a-5019-4a60-8e30-8a2007a40350 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 200 len: 1365 microversion: 2.1 time: 0.154300 May 25 15:01:18.939345 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 249/511] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:18 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:19.036626 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-baacb02c-f579-478b-9e8e-d9e5df8d194a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:19.037227 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-baacb02c-f579-478b-9e8e-d9e5df8d194a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:19.043790 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-baacb02c-f579-478b-9e8e-d9e5df8d194a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:19.044237 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-baacb02c-f579-478b-9e8e-d9e5df8d194a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:19.045044 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-baacb02c-f579-478b-9e8e-d9e5df8d194a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:19.045479 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-baacb02c-f579-478b-9e8e-d9e5df8d194a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:19.428708 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-baacb02c-f579-478b-9e8e-d9e5df8d194a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:19.436964 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-baacb02c-f579-478b-9e8e-d9e5df8d194a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1733 microversion: 2.1 time: 0.405720 May 25 15:01:19.437783 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 263/512] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:19 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1733 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:19.956273 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-9981def2-dccf-47b7-984c-a5f9816a9bfe tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:19.956890 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-9981def2-dccf-47b7-984c-a5f9816a9bfe tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:19.964154 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9981def2-dccf-47b7-984c-a5f9816a9bfe tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:19.964604 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9981def2-dccf-47b7-984c-a5f9816a9bfe tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:19.965381 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9981def2-dccf-47b7-984c-a5f9816a9bfe tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:19.965817 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9981def2-dccf-47b7-984c-a5f9816a9bfe tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:20.100051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-9981def2-dccf-47b7-984c-a5f9816a9bfe tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:20.108034 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-9981def2-dccf-47b7-984c-a5f9816a9bfe tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 200 len: 1365 microversion: 2.1 time: 0.156184 May 25 15:01:20.108705 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 250/513] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:19 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:20.455689 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-64cf136c-cdbf-434b-9db0-6421aafbf035 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:20.456253 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-64cf136c-cdbf-434b-9db0-6421aafbf035 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:20.463036 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-64cf136c-cdbf-434b-9db0-6421aafbf035 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:20.463475 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-64cf136c-cdbf-434b-9db0-6421aafbf035 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:20.464242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-64cf136c-cdbf-434b-9db0-6421aafbf035 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:20.464672 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-64cf136c-cdbf-434b-9db0-6421aafbf035 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:20.599416 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-64cf136c-cdbf-434b-9db0-6421aafbf035 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:20.607670 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-64cf136c-cdbf-434b-9db0-6421aafbf035 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1733 microversion: 2.1 time: 0.155943 May 25 15:01:20.608234 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 264/514] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:20 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:21.126546 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-980a60fb-2f4b-4321-b046-d8b365485026 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:21.127175 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-980a60fb-2f4b-4321-b046-d8b365485026 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:21.134908 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-980a60fb-2f4b-4321-b046-d8b365485026 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:21.135357 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-980a60fb-2f4b-4321-b046-d8b365485026 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:21.136134 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-980a60fb-2f4b-4321-b046-d8b365485026 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:21.136564 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-980a60fb-2f4b-4321-b046-d8b365485026 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:21.274001 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-980a60fb-2f4b-4321-b046-d8b365485026 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:21.283999 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-980a60fb-2f4b-4321-b046-d8b365485026 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 200 len: 1365 microversion: 2.1 time: 0.161312 May 25 15:01:21.284575 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 251/515] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:21 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:21.535335 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-5cccfe63-a64c-4f16-a3cf-dfaa24e8592b req-af96d4b7-af7f-4deb-a107-7ad5540ffc46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd834bb-ffdb-40c9-9585-cb81a52a3322", "name": "network-vif-plugged", "status": "completed", "tag": "f723a574-6986-4689-9b35-12c406a41e8e"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:21.543601 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-5cccfe63-a64c-4f16-a3cf-dfaa24e8592b req-af96d4b7-af7f-4deb-a107-7ad5540ffc46 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:21.544042 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-5cccfe63-a64c-4f16-a3cf-dfaa24e8592b req-af96d4b7-af7f-4deb-a107-7ad5540ffc46 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:21.555645 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-5cccfe63-a64c-4f16-a3cf-dfaa24e8592b req-af96d4b7-af7f-4deb-a107-7ad5540ffc46 service nova] Creating event network-vif-plugged:f723a574-6986-4689-9b35-12c406a41e8e for instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 on hv-cinder-80382 May 25 15:01:21.560307 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-5cccfe63-a64c-4f16-a3cf-dfaa24e8592b req-af96d4b7-af7f-4deb-a107-7ad5540ffc46 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028677 May 25 15:01:21.560903 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 265/516] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:21.625404 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-860d91c1-fb7a-441e-b1ae-fc44b3798a74 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:21.626153 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-860d91c1-fb7a-441e-b1ae-fc44b3798a74 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:21.633196 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-860d91c1-fb7a-441e-b1ae-fc44b3798a74 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:21.633674 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-860d91c1-fb7a-441e-b1ae-fc44b3798a74 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:21.634828 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-860d91c1-fb7a-441e-b1ae-fc44b3798a74 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:21.635289 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-860d91c1-fb7a-441e-b1ae-fc44b3798a74 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:21.775420 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-860d91c1-fb7a-441e-b1ae-fc44b3798a74 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:21.783600 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-860d91c1-fb7a-441e-b1ae-fc44b3798a74 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1733 microversion: 2.1 time: 0.162608 May 25 15:01:21.784188 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 252/517] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:21 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:22.302174 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8b6dee25-b02a-4edb-8c70-17b51d391630 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:22.302890 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8b6dee25-b02a-4edb-8c70-17b51d391630 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:22.309747 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8b6dee25-b02a-4edb-8c70-17b51d391630 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:22.310230 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8b6dee25-b02a-4edb-8c70-17b51d391630 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:22.311007 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8b6dee25-b02a-4edb-8c70-17b51d391630 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:22.311439 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8b6dee25-b02a-4edb-8c70-17b51d391630 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:22.461350 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8b6dee25-b02a-4edb-8c70-17b51d391630 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:22.469026 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8b6dee25-b02a-4edb-8c70-17b51d391630 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 200 len: 1365 microversion: 2.1 time: 0.171803 May 25 15:01:22.469595 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 266/518] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:22 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:01:22.802292 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-3366a5b2-2b24-476c-b0a0-9955aa2bd8bd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:22.802918 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-3366a5b2-2b24-476c-b0a0-9955aa2bd8bd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:22.809556 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3366a5b2-2b24-476c-b0a0-9955aa2bd8bd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:22.810004 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3366a5b2-2b24-476c-b0a0-9955aa2bd8bd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:22.810814 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3366a5b2-2b24-476c-b0a0-9955aa2bd8bd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:22.811254 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3366a5b2-2b24-476c-b0a0-9955aa2bd8bd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:22.959826 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3366a5b2-2b24-476c-b0a0-9955aa2bd8bd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:22.968135 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-3366a5b2-2b24-476c-b0a0-9955aa2bd8bd tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1713 microversion: 2.1 time: 0.170239 May 25 15:01:22.968725 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 253/519] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:22 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1713 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:23.032439 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ad7576fd-b39a-4425-8618-c4636e59b103 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:23.033038 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ad7576fd-b39a-4425-8618-c4636e59b103 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:23.035067 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=2 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:23.042139 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ad7576fd-b39a-4425-8618-c4636e59b103 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:23.042589 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ad7576fd-b39a-4425-8618-c4636e59b103 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:23.043372 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ad7576fd-b39a-4425-8618-c4636e59b103 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:23.043810 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ad7576fd-b39a-4425-8618-c4636e59b103 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:23.140383 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-ad7576fd-b39a-4425-8618-c4636e59b103 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] HTTP exception thrown: Cannot 'detach_volume' instance 58a68392-711b-4106-990e-f6ad82525d59 while it is in vm_state rescued May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ad7576fd-b39a-4425-8618-c4636e59b103 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Request method failure captured: May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: DELETE /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/os-volume_attachments/20855e94-0219-403a-87ff-754990affb7e HTTP/1.1 May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkOQmzSr_Z_HaubRx-8K0J1aivmzZNuHz2evwqGBpOEbVW_8T5qrSA5J06do9eAUOA11aw7skoO4YnbInUibqk41nPye7EGvIZtAObWYp0uJQiTEIBAVIL8lmFYJs7jq459Lvk6nm7QXpTp2CW9MWVgJbxByPFp56Fy8X_ZzDq-0ZWA May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: acd27057280d4bdda5b9a689a1e399ff May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1162490831 May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:01:23.142308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:01:23.143855 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_acd27057280d4bdda5b9a689a1e399ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/acd27057280d4bdda5b9a689a1e399ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/acd27057280d4bdda5b9a689a1e399ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/acd27057280d4bdda5b9a689a1e399ff"}]}] May 25 15:01:23.143855 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1162490831 May 25 15:01:23.143855 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: acd27057280d4bdda5b9a689a1e399ff May 25 15:01:23.143855 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1162490831 May 25 15:01:23.143855 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-ServerRescueNegativeTestJSON-1162490831-project May 25 15:01:23.143855 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:01:23.143855 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:01:23.143855 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: 97011bf8f6d444468fecdde7acfa1020 May 25 15:01:23.143855 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1162490831-project May 25 15:01:23.143855 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:01:23.143855 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Cannot 'detach_volume' instance 58a68392-711b-4106-990e-f6ad82525d59 while it is in vm_state rescued May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'server_id': '58a68392-711b-4106-990e-f6ad82525d59', 'id': '20855e94-0219-403a-87ff-754990affb7e'} May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 58a68392-711b-4106-990e-f6ad82525d59 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:01:23.144523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:01:23.145850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 25 15:01:23.145850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 25 15:01:23.145850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 25 15:01:23.145850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 25 15:01:23.145850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 58a68392-711b-4106-990e-f6ad82525d59 while it is in vm_state rescued May 25 15:01:23.145850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:01:23.145850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:01:23.145850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:01:23.145850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:23.145850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:01:23.145850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:01:23.145850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:01:23.145850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:01:23.145850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 58a68392-711b-4106-990e-f6ad82525d59 while it is in vm_state rescued May 25 15:01:23.145850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:01:23.145850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ad7576fd-b39a-4425-8618-c4636e59b103 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Returning 409 to user: Cannot 'detach_volume' instance 58a68392-711b-4106-990e-f6ad82525d59 while it is in vm_state rescued {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:01:23.146866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ad7576fd-b39a-4425-8618-c4636e59b103 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "DELETE /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/os-volume_attachments/20855e94-0219-403a-87ff-754990affb7e" status: 409 len: 152 microversion: 2.1 time: 0.116313 May 25 15:01:23.146866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 267/520] 10.222.0.78 () {58 vars in 1415 bytes} [Wed May 25 15:01:23 2022] DELETE /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/os-volume_attachments/20855e94-0219-403a-87ff-754990affb7e => generated 152 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 25 15:01:23.153134 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-85e67327-a1da-48da-879f-2068c5882e63 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:23.153698 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-85e67327-a1da-48da-879f-2068c5882e63 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:23.159997 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-85e67327-a1da-48da-879f-2068c5882e63 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:23.160433 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-85e67327-a1da-48da-879f-2068c5882e63 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:23.161710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-85e67327-a1da-48da-879f-2068c5882e63 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:23.162215 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-85e67327-a1da-48da-879f-2068c5882e63 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:23.241175 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-85e67327-a1da-48da-879f-2068c5882e63 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "POST /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/action" status: 202 len: 0 microversion: 2.1 time: 0.091517 May 25 15:01:23.241844 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 254/521] 10.222.0.78 () {60 vars in 1277 bytes} [Wed May 25 15:01:23 2022] POST /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:01:23.250555 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-6199db3c-869a-45aa-a46b-ee891e6e9ad7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:23.251166 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-6199db3c-869a-45aa-a46b-ee891e6e9ad7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:23.253062 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=12 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:23.263002 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6199db3c-869a-45aa-a46b-ee891e6e9ad7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:23.263448 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6199db3c-869a-45aa-a46b-ee891e6e9ad7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:23.264245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6199db3c-869a-45aa-a46b-ee891e6e9ad7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:23.264674 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6199db3c-869a-45aa-a46b-ee891e6e9ad7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:23.423629 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-6199db3c-869a-45aa-a46b-ee891e6e9ad7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:23.435246 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-6199db3c-869a-45aa-a46b-ee891e6e9ad7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1721 microversion: 2.1 time: 0.188787 May 25 15:01:23.435852 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 268/522] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:23 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:01:23.488040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-75e5c2f1-dd93-497e-a6f2-b330b7d8bcdb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:23.489570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-75e5c2f1-dd93-497e-a6f2-b330b7d8bcdb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:23.498359 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-75e5c2f1-dd93-497e-a6f2-b330b7d8bcdb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:23.498848 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-75e5c2f1-dd93-497e-a6f2-b330b7d8bcdb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:23.499638 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-75e5c2f1-dd93-497e-a6f2-b330b7d8bcdb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:23.500071 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-75e5c2f1-dd93-497e-a6f2-b330b7d8bcdb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:23.654274 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-75e5c2f1-dd93-497e-a6f2-b330b7d8bcdb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:23.662432 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-75e5c2f1-dd93-497e-a6f2-b330b7d8bcdb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 200 len: 1365 microversion: 2.1 time: 0.179798 May 25 15:01:23.662984 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 255/523] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:23 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:24.452993 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-183ead79-4ea4-4267-8c64-66ed3563278c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:24.453633 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-183ead79-4ea4-4267-8c64-66ed3563278c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:24.460070 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-183ead79-4ea4-4267-8c64-66ed3563278c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:24.460520 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-183ead79-4ea4-4267-8c64-66ed3563278c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:24.461350 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-183ead79-4ea4-4267-8c64-66ed3563278c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:24.461788 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-183ead79-4ea4-4267-8c64-66ed3563278c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:24.639739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-183ead79-4ea4-4267-8c64-66ed3563278c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:24.648391 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-183ead79-4ea4-4267-8c64-66ed3563278c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1721 microversion: 2.1 time: 0.199402 May 25 15:01:24.648947 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 269/524] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:24 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:24.679848 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-86db4136-96a3-406c-846e-4143ce8e5b60 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:24.680460 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-86db4136-96a3-406c-846e-4143ce8e5b60 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:24.687038 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-86db4136-96a3-406c-846e-4143ce8e5b60 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:24.687487 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-86db4136-96a3-406c-846e-4143ce8e5b60 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:24.688249 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-86db4136-96a3-406c-846e-4143ce8e5b60 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:24.688683 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-86db4136-96a3-406c-846e-4143ce8e5b60 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:24.816592 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-86db4136-96a3-406c-846e-4143ce8e5b60 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:24.823940 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-86db4136-96a3-406c-846e-4143ce8e5b60 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 200 len: 1365 microversion: 2.1 time: 0.148513 May 25 15:01:24.824495 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 256/525] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:24 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:25.664664 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2a888724-c64a-41c9-9bef-de5cb9eb9624 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:25.665214 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2a888724-c64a-41c9-9bef-de5cb9eb9624 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:25.671247 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2a888724-c64a-41c9-9bef-de5cb9eb9624 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:25.671810 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2a888724-c64a-41c9-9bef-de5cb9eb9624 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:25.672458 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2a888724-c64a-41c9-9bef-de5cb9eb9624 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:25.672895 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2a888724-c64a-41c9-9bef-de5cb9eb9624 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:25.840520 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-fea4d9c8-82e8-4394-8f2f-a4c538d9968b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:25.841255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-fea4d9c8-82e8-4394-8f2f-a4c538d9968b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:25.848143 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fea4d9c8-82e8-4394-8f2f-a4c538d9968b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:25.849340 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fea4d9c8-82e8-4394-8f2f-a4c538d9968b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:25.850163 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fea4d9c8-82e8-4394-8f2f-a4c538d9968b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:25.850603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fea4d9c8-82e8-4394-8f2f-a4c538d9968b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:25.901898 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2a888724-c64a-41c9-9bef-de5cb9eb9624 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:25.913218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2a888724-c64a-41c9-9bef-de5cb9eb9624 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1721 microversion: 2.1 time: 0.251958 May 25 15:01:25.913845 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 270/526] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:25 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:25.986819 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-fea4d9c8-82e8-4394-8f2f-a4c538d9968b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:25.994278 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-fea4d9c8-82e8-4394-8f2f-a4c538d9968b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 200 len: 1556 microversion: 2.1 time: 0.157577 May 25 15:01:25.994829 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 257/527] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:25 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:01:26.011528 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ef7b9b02-183c-4afc-9e5c-2200516aaf7d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:26.012054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ef7b9b02-183c-4afc-9e5c-2200516aaf7d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:26.018373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ef7b9b02-183c-4afc-9e5c-2200516aaf7d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:26.018852 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ef7b9b02-183c-4afc-9e5c-2200516aaf7d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:26.019623 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ef7b9b02-183c-4afc-9e5c-2200516aaf7d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:26.020665 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ef7b9b02-183c-4afc-9e5c-2200516aaf7d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:26.099170 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ef7b9b02-183c-4afc-9e5c-2200516aaf7d tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091489 May 25 15:01:26.099391 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 271/528] 10.222.0.78 () {58 vars in 1274 bytes} [Wed May 25 15:01:26 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:01:26.930721 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-668fbf20-6718-4ecd-9bf7-9246b5867655 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:26.931325 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-668fbf20-6718-4ecd-9bf7-9246b5867655 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:26.938805 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-668fbf20-6718-4ecd-9bf7-9246b5867655 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:26.939249 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-668fbf20-6718-4ecd-9bf7-9246b5867655 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:26.949698 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-668fbf20-6718-4ecd-9bf7-9246b5867655 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:26.950187 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-668fbf20-6718-4ecd-9bf7-9246b5867655 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:27.058513 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-536b9b03-5eac-4b08-a2a5-49952b25e470 req-1eea026f-ac83-4e89-a128-c22961d3e792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd834bb-ffdb-40c9-9585-cb81a52a3322", "tag": "f723a574-6986-4689-9b35-12c406a41e8e"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:27.066662 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-536b9b03-5eac-4b08-a2a5-49952b25e470 req-1eea026f-ac83-4e89-a128-c22961d3e792 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:27.067134 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-536b9b03-5eac-4b08-a2a5-49952b25e470 req-1eea026f-ac83-4e89-a128-c22961d3e792 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:27.079097 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-536b9b03-5eac-4b08-a2a5-49952b25e470 req-1eea026f-ac83-4e89-a128-c22961d3e792 service nova] Creating event network-changed:f723a574-6986-4689-9b35-12c406a41e8e for instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 on hv-cinder-80382 May 25 15:01:27.084600 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-536b9b03-5eac-4b08-a2a5-49952b25e470 req-1eea026f-ac83-4e89-a128-c22961d3e792 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029716 May 25 15:01:27.085219 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 272/529] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:27.093858 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-668fbf20-6718-4ecd-9bf7-9246b5867655 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:27.102655 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-668fbf20-6718-4ecd-9bf7-9246b5867655 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1721 microversion: 2.1 time: 0.176350 May 25 15:01:27.103228 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 258/530] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:26 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:28.120819 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ff1f152a-1cec-4883-a48d-ed9b3fe6f1af tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:28.121475 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ff1f152a-1cec-4883-a48d-ed9b3fe6f1af tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:28.127677 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ff1f152a-1cec-4883-a48d-ed9b3fe6f1af tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:28.128129 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ff1f152a-1cec-4883-a48d-ed9b3fe6f1af tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:28.128897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ff1f152a-1cec-4883-a48d-ed9b3fe6f1af tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:28.129384 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ff1f152a-1cec-4883-a48d-ed9b3fe6f1af tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:28.266383 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ff1f152a-1cec-4883-a48d-ed9b3fe6f1af tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:28.274973 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ff1f152a-1cec-4883-a48d-ed9b3fe6f1af tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1721 microversion: 2.1 time: 0.158564 May 25 15:01:28.275536 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 273/531] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:28 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:29.292827 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-42ce0a07-3bf5-43ae-a3eb-21eaa9baabad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:29.293435 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-42ce0a07-3bf5-43ae-a3eb-21eaa9baabad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:29.300294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-42ce0a07-3bf5-43ae-a3eb-21eaa9baabad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:29.300743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-42ce0a07-3bf5-43ae-a3eb-21eaa9baabad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:29.302274 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-42ce0a07-3bf5-43ae-a3eb-21eaa9baabad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:29.302711 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-42ce0a07-3bf5-43ae-a3eb-21eaa9baabad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:29.431889 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-42ce0a07-3bf5-43ae-a3eb-21eaa9baabad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:29.439840 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-42ce0a07-3bf5-43ae-a3eb-21eaa9baabad tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1727 microversion: 2.1 time: 0.151175 May 25 15:01:29.440396 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 259/532] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:29 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:29.455894 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-1826c895-cf26-42d0-9861-ce4d99198ea7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:29.456419 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-1826c895-cf26-42d0-9861-ce4d99198ea7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:29.463137 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1826c895-cf26-42d0-9861-ce4d99198ea7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:29.463609 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1826c895-cf26-42d0-9861-ce4d99198ea7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:29.464502 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1826c895-cf26-42d0-9861-ce4d99198ea7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:29.464968 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1826c895-cf26-42d0-9861-ce4d99198ea7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:29.545833 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-1826c895-cf26-42d0-9861-ce4d99198ea7 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093749 May 25 15:01:29.546451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 274/533] 10.222.0.78 () {58 vars in 1274 bytes} [Wed May 25 15:01:29 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:30.870957 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-525f0043-bbb0-4bfc-84e0-e838b6fb0ed4 req-f046f423-b818-4f3f-90dd-fd8eb73b831b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58a68392-711b-4106-990e-f6ad82525d59", "tag": "219ede9e-3779-4194-a09a-08090b45e691"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:30.881139 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-525f0043-bbb0-4bfc-84e0-e838b6fb0ed4 req-f046f423-b818-4f3f-90dd-fd8eb73b831b service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:30.881916 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-525f0043-bbb0-4bfc-84e0-e838b6fb0ed4 req-f046f423-b818-4f3f-90dd-fd8eb73b831b service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:30.886388 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:30.894997 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-525f0043-bbb0-4bfc-84e0-e838b6fb0ed4 req-f046f423-b818-4f3f-90dd-fd8eb73b831b service nova] Creating event network-changed:219ede9e-3779-4194-a09a-08090b45e691 for instance 58a68392-711b-4106-990e-f6ad82525d59 on hv-cinder-80382 May 25 15:01:30.903182 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-525f0043-bbb0-4bfc-84e0-e838b6fb0ed4 req-f046f423-b818-4f3f-90dd-fd8eb73b831b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033777 May 25 15:01:30.903182 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 260/534] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:32.973544 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-297b2397-9bd0-4fbc-8a32-e94ae5daed94 req-2a7a4815-de07-4b84-b694-f1e56cd27ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58a68392-711b-4106-990e-f6ad82525d59", "tag": "219ede9e-3779-4194-a09a-08090b45e691"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:32.981573 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-297b2397-9bd0-4fbc-8a32-e94ae5daed94 req-2a7a4815-de07-4b84-b694-f1e56cd27ed7 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:32.982004 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-297b2397-9bd0-4fbc-8a32-e94ae5daed94 req-2a7a4815-de07-4b84-b694-f1e56cd27ed7 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:32.993368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-297b2397-9bd0-4fbc-8a32-e94ae5daed94 req-2a7a4815-de07-4b84-b694-f1e56cd27ed7 service nova] Creating event network-changed:219ede9e-3779-4194-a09a-08090b45e691 for instance 58a68392-711b-4106-990e-f6ad82525d59 on hv-cinder-80382 May 25 15:01:32.998330 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-297b2397-9bd0-4fbc-8a32-e94ae5daed94 req-2a7a4815-de07-4b84-b694-f1e56cd27ed7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086994 May 25 15:01:32.998911 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 275/535] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:47.797582 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-270bde02-aca1-46a1-b7a7-d9885c764804 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:47.798672 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-270bde02-aca1-46a1-b7a7-d9885c764804 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:47.802078 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=43 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:47.809314 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-270bde02-aca1-46a1-b7a7-d9885c764804 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:47.809865 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-270bde02-aca1-46a1-b7a7-d9885c764804 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:47.810679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-270bde02-aca1-46a1-b7a7-d9885c764804 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:47.811119 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-270bde02-aca1-46a1-b7a7-d9885c764804 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:47.840487 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-270bde02-aca1-46a1-b7a7-d9885c764804 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047141 May 25 15:01:47.841036 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 261/536] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:01:47 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:01:47.897653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:47.898414 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=70 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:47.902508 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-27570a3a-a4f0-47ff-bb63-a40bcddb5bdc tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:47.903067 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-27570a3a-a4f0-47ff-bb63-a40bcddb5bdc tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:47.911041 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-27570a3a-a4f0-47ff-bb63-a40bcddb5bdc tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:47.911491 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-27570a3a-a4f0-47ff-bb63-a40bcddb5bdc tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:47.912248 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-27570a3a-a4f0-47ff-bb63-a40bcddb5bdc tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:47.912676 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-27570a3a-a4f0-47ff-bb63-a40bcddb5bdc tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:47.939229 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-27570a3a-a4f0-47ff-bb63-a40bcddb5bdc tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Going to try to terminate instance {{(pid=124523) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:01:48.014522 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-27570a3a-a4f0-47ff-bb63-a40bcddb5bdc tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 204 len: 0 microversion: 2.1 time: 0.117724 May 25 15:01:48.015386 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 276/537] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:01:47 2022] DELETE /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:01:48.023183 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-035f2fa8-2eb3-4f78-9cb4-6a1dc547d9f1 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:48.023832 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-035f2fa8-2eb3-4f78-9cb4-6a1dc547d9f1 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:48.031042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-035f2fa8-2eb3-4f78-9cb4-6a1dc547d9f1 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:48.031489 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-035f2fa8-2eb3-4f78-9cb4-6a1dc547d9f1 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:48.032264 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-035f2fa8-2eb3-4f78-9cb4-6a1dc547d9f1 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:48.032767 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-035f2fa8-2eb3-4f78-9cb4-6a1dc547d9f1 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:48.167041 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-035f2fa8-2eb3-4f78-9cb4-6a1dc547d9f1 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:48.174437 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-035f2fa8-2eb3-4f78-9cb4-6a1dc547d9f1 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1670 microversion: 2.1 time: 0.155099 May 25 15:01:48.174995 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 262/538] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:48 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:01:49.193033 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-28cf68a4-2689-4083-9478-d3b2e06b70c9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:49.193654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-28cf68a4-2689-4083-9478-d3b2e06b70c9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:49.200388 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-28cf68a4-2689-4083-9478-d3b2e06b70c9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:49.200846 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-28cf68a4-2689-4083-9478-d3b2e06b70c9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:49.201628 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-28cf68a4-2689-4083-9478-d3b2e06b70c9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:49.202096 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-28cf68a4-2689-4083-9478-d3b2e06b70c9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:49.337305 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-28cf68a4-2689-4083-9478-d3b2e06b70c9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:49.344937 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-28cf68a4-2689-4083-9478-d3b2e06b70c9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1670 microversion: 2.1 time: 0.156355 May 25 15:01:49.345490 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 277/539] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:49 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:50.361867 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2f4d6a85-5c9f-4bc9-8222-dedbf3c6d338 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:50.362527 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2f4d6a85-5c9f-4bc9-8222-dedbf3c6d338 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:50.369156 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2f4d6a85-5c9f-4bc9-8222-dedbf3c6d338 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:50.369603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2f4d6a85-5c9f-4bc9-8222-dedbf3c6d338 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:50.370543 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2f4d6a85-5c9f-4bc9-8222-dedbf3c6d338 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:50.370980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2f4d6a85-5c9f-4bc9-8222-dedbf3c6d338 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:50.496997 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-2f4d6a85-5c9f-4bc9-8222-dedbf3c6d338 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:50.504473 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2f4d6a85-5c9f-4bc9-8222-dedbf3c6d338 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1670 microversion: 2.1 time: 0.146424 May 25 15:01:50.505045 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 263/540] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:50 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1670 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:51.522718 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-29703de4-ca6c-4f95-8eba-4fa0f91f1a82 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:51.523485 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-29703de4-ca6c-4f95-8eba-4fa0f91f1a82 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:51.530457 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-29703de4-ca6c-4f95-8eba-4fa0f91f1a82 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:51.530894 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-29703de4-ca6c-4f95-8eba-4fa0f91f1a82 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:51.531665 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-29703de4-ca6c-4f95-8eba-4fa0f91f1a82 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:51.532094 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-29703de4-ca6c-4f95-8eba-4fa0f91f1a82 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:51.607861 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-29703de4-ca6c-4f95-8eba-4fa0f91f1a82 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:51.615504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-29703de4-ca6c-4f95-8eba-4fa0f91f1a82 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 200 len: 1602 microversion: 2.1 time: 0.096853 May 25 15:01:51.616335 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 278/541] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:51 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 1602 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:51.724000 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-5edf7e06-7b00-4cfc-b91d-e680ef7f8ff1 req-90d477b8-c577-4325-a3ac-f7bb882852ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be96576-0efd-4362-8e0d-f74b16ddc912", "name": "network-vif-deleted", "tag": "17ca4119-5e7a-4061-9769-ec64b6238082"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:51.732877 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-5edf7e06-7b00-4cfc-b91d-e680ef7f8ff1 req-90d477b8-c577-4325-a3ac-f7bb882852ee service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:51.733324 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-5edf7e06-7b00-4cfc-b91d-e680ef7f8ff1 req-90d477b8-c577-4325-a3ac-f7bb882852ee service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:51.745492 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-5edf7e06-7b00-4cfc-b91d-e680ef7f8ff1 req-90d477b8-c577-4325-a3ac-f7bb882852ee service nova] Creating event network-vif-deleted:17ca4119-5e7a-4061-9769-ec64b6238082 for instance 6be96576-0efd-4362-8e0d-f74b16ddc912 on hv-cinder-80382 May 25 15:01:51.752641 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-5edf7e06-7b00-4cfc-b91d-e680ef7f8ff1 req-90d477b8-c577-4325-a3ac-f7bb882852ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031758 May 25 15:01:51.754298 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 264/542] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:52.635546 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e96f2db5-99d2-430f-bd15-f0c625e9be5b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:52.636293 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e96f2db5-99d2-430f-bd15-f0c625e9be5b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:52.647064 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e96f2db5-99d2-430f-bd15-f0c625e9be5b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:52.647867 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e96f2db5-99d2-430f-bd15-f0c625e9be5b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:52.650347 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e96f2db5-99d2-430f-bd15-f0c625e9be5b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:52.651168 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e96f2db5-99d2-430f-bd15-f0c625e9be5b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:52.671187 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-e96f2db5-99d2-430f-bd15-f0c625e9be5b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] HTTP exception thrown: Instance 6be96576-0efd-4362-8e0d-f74b16ddc912 could not be found. May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e96f2db5-99d2-430f-bd15-f0c625e9be5b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Request method failure captured: May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 HTTP/1.1 May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkOMGxLp5La0duucSziDTnmPb4MU3_K5UmVHkmMTzOrKf4CDiWgoAAMnWidsfANdWM6N22uaVZw8H4Gi4s6gZps3-l9ke1k9LwV8gtAhQi1hEe9iYagGpPwWa0uPizubIvmE_UQXOMQcsRQ7l6vRyCvGnhYjwCuJur35xzymhn2liVU May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 2395f31fad3645c19096d648c521bf31 May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-AttachVolumeTestJSON-925279656 May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:01:52.672069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:01:52.676252 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2395f31fad3645c19096d648c521bf31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2395f31fad3645c19096d648c521bf31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2395f31fad3645c19096d648c521bf31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2395f31fad3645c19096d648c521bf31"}]}] May 25 15:01:52.676252 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-AttachVolumeTestJSON-925279656 May 25 15:01:52.676252 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 2395f31fad3645c19096d648c521bf31 May 25 15:01:52.676252 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-AttachVolumeTestJSON-925279656 May 25 15:01:52.676252 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-AttachVolumeTestJSON-925279656-project May 25 15:01:52.676252 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:01:52.676252 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:01:52.676252 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: 7fedb9b92e9a4e3cb671f69751e426a1 May 25 15:01:52.676252 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-AttachVolumeTestJSON-925279656-project May 25 15:01:52.676252 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:01:52.676252 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance 6be96576-0efd-4362-8e0d-f74b16ddc912 could not be found. May 25 15:01:52.676252 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': '6be96576-0efd-4362-8e0d-f74b16ddc912'} May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be96576-0efd-4362-8e0d-f74b16ddc912 could not be found. May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:01:52.677373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:01:52.679599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:01:52.679599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:01:52.679599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:01:52.679599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:01:52.679599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:01:52.679599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:01:52.679599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:01:52.679599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be96576-0efd-4362-8e0d-f74b16ddc912 could not be found. May 25 15:01:52.679599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:01:52.679599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:01:52.679599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:01:52.679599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:52.679599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:01:52.679599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:01:52.679599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:01:52.679599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:01:52.679599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be96576-0efd-4362-8e0d-f74b16ddc912 could not be found. May 25 15:01:52.679599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:01:52.682555 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e96f2db5-99d2-430f-bd15-f0c625e9be5b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Returning 404 to user: Instance 6be96576-0efd-4362-8e0d-f74b16ddc912 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:01:52.682555 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e96f2db5-99d2-430f-bd15-f0c625e9be5b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 404 len: 111 microversion: 2.1 time: 0.044128 May 25 15:01:52.682555 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 279/543] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:52 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:01:52.691871 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-caf817d9-dc20-4385-add3-612168aabeb9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '.version_select at 0x7fb1dade4280>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:52.714346 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-caf817d9-dc20-4385-add3-612168aabeb9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-71989662" status: 202 len: 0 microversion: 2.1 time: 0.029320 May 25 15:01:52.715032 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 265/544] 10.222.0.78 () {58 vars in 1214 bytes} [Wed May 25 15:01:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-71989662 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:01:53.418315 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b5f66dfb-2a22-4324-bae4-1fb64fcd202c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Action: 'create', calling method: .version_select at 0x7fb1e0086790>, body: {"keypair": {"name": "tempest-keypair-983056680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFk1xvsSsCmvavdFJJ/Q/VRuC2KAYW8T32K5meMeiiyShGJ3C759M5skCkE0DJ3N+oMmB+4S9z+fdY54FDmxF8sKzvRXhLv9Jvk1XNXlEOQgHveiTh2M9ITwwgK/Zyg9UQ=="}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:53.432854 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-b5f66dfb-2a22-4324-bae4-1fb64fcd202c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Getting quotas for project 2395f31fad3645c19096d648c521bf31. Resources: {'key_pairs'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:01:53.437290 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-b5f66dfb-2a22-4324-bae4-1fb64fcd202c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Getting quotas for user 7fedb9b92e9a4e3cb671f69751e426a1 and project 2395f31fad3645c19096d648c521bf31. Resources: {'key_pairs'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:01:53.463119 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-b5f66dfb-2a22-4324-bae4-1fb64fcd202c tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048553 May 25 15:01:53.463745 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 280/545] 10.222.0.78 () {60 vars in 1158 bytes} [Wed May 25 15:01:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:54.959934 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-5ac8a8de-8006-44c8-a295-0a9649b1186f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-348966026", "imageRef": "fbec7c78-0103-4632-9a21-d8e8056f2ce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da3cdcb2-1ede-42ee-8e56-23a36c228a18"}], "security_groups": [{"name": "tempest-securitygroup--2003856802"}], "key_name": "tempest-keypair-983056680", "user_data": "}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:55.060630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.network.neutron [None req-5ac8a8de-8006-44c8-a295-0a9649b1186f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] validate_networks() for [('da3cdcb2-1ede-42ee-8e56-23a36c228a18', None, None, None, None, None)] {{(pid=124524) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:01:55.690480 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-5ac8a8de-8006-44c8-a295-0a9649b1186f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Flavor limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:01:55.690899 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-5ac8a8de-8006-44c8-a295-0a9649b1186f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Image limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:01:55.691398 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-5ac8a8de-8006-44c8-a295-0a9649b1186f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Flavor pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:01:55.691808 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-5ac8a8de-8006-44c8-a295-0a9649b1186f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Image pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:01:55.692213 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-5ac8a8de-8006-44c8-a295-0a9649b1186f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:01:55.701201 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5ac8a8de-8006-44c8-a295-0a9649b1186f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:55.701640 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5ac8a8de-8006-44c8-a295-0a9649b1186f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:55.702471 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5ac8a8de-8006-44c8-a295-0a9649b1186f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:55.702907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5ac8a8de-8006-44c8-a295-0a9649b1186f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:55.720352 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-5ac8a8de-8006-44c8-a295-0a9649b1186f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Getting quotas for project 2395f31fad3645c19096d648c521bf31. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:01:55.724590 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-5ac8a8de-8006-44c8-a295-0a9649b1186f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Getting quotas for user 7fedb9b92e9a4e3cb671f69751e426a1 and project 2395f31fad3645c19096d648c521bf31. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:01:55.736351 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-5ac8a8de-8006-44c8-a295-0a9649b1186f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Going to run 1 instances... {{(pid=124524) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:01:55.738741 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-5ac8a8de-8006-44c8-a295-0a9649b1186f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbec7c78-0103-4632-9a21-d8e8056f2ce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:01:55.788725 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-5ac8a8de-8006-44c8-a295-0a9649b1186f tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.833828 May 25 15:01:55.790263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 266/546] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 15:01:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:01:55.804526 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-1e4b852c-baa8-4ba4-9297-974a28ff2a14 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:55.806512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-1e4b852c-baa8-4ba4-9297-974a28ff2a14 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:56.130718 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-1e4b852c-baa8-4ba4-9297-974a28ff2a14 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:56.138513 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-1e4b852c-baa8-4ba4-9297-974a28ff2a14 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 200 len: 1236 microversion: 2.1 time: 0.341793 May 25 15:01:56.139062 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 281/547] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:55 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 1236 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:57.159206 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-467056c6-8bde-4a95-9e58-9f3d3ef0279a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:57.160267 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-467056c6-8bde-4a95-9e58-9f3d3ef0279a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:57.170164 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-467056c6-8bde-4a95-9e58-9f3d3ef0279a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:57.170634 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-467056c6-8bde-4a95-9e58-9f3d3ef0279a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:57.171644 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-467056c6-8bde-4a95-9e58-9f3d3ef0279a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:57.172096 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-467056c6-8bde-4a95-9e58-9f3d3ef0279a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:57.239152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-467056c6-8bde-4a95-9e58-9f3d3ef0279a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:57.247819 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-467056c6-8bde-4a95-9e58-9f3d3ef0279a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 200 len: 1306 microversion: 2.1 time: 0.096011 May 25 15:01:57.248402 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 267/548] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:57 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 1306 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:58.267243 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-6a84043d-2cd3-4cbe-9865-efd3e0280855 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:58.268139 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-6a84043d-2cd3-4cbe-9865-efd3e0280855 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:58.276104 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6a84043d-2cd3-4cbe-9865-efd3e0280855 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:58.276551 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6a84043d-2cd3-4cbe-9865-efd3e0280855 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:58.277353 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6a84043d-2cd3-4cbe-9865-efd3e0280855 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:58.277792 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6a84043d-2cd3-4cbe-9865-efd3e0280855 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:58.500585 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-6a84043d-2cd3-4cbe-9865-efd3e0280855 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:58.508433 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-6a84043d-2cd3-4cbe-9865-efd3e0280855 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 200 len: 1362 microversion: 2.1 time: 0.246208 May 25 15:01:58.509166 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 282/549] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:58 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:58.886376 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-715bf1f6-904b-4881-90d0-0a5cb16a0b63 req-4d63597b-d518-4d29-9a0f-c0afdb0296c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c199bd9-ce9c-4761-9f84-042971621d9c", "tag": "e879175d-ad6e-45f8-890b-d64ddeb1ddf4"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:58.904060 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-715bf1f6-904b-4881-90d0-0a5cb16a0b63 req-4d63597b-d518-4d29-9a0f-c0afdb0296c4 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:58.904507 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-715bf1f6-904b-4881-90d0-0a5cb16a0b63 req-4d63597b-d518-4d29-9a0f-c0afdb0296c4 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:58.917268 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-715bf1f6-904b-4881-90d0-0a5cb16a0b63 req-4d63597b-d518-4d29-9a0f-c0afdb0296c4 service nova] Creating event network-changed:e879175d-ad6e-45f8-890b-d64ddeb1ddf4 for instance 0c199bd9-ce9c-4761-9f84-042971621d9c on hv-cinder-80382 May 25 15:01:58.922312 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-715bf1f6-904b-4881-90d0-0a5cb16a0b63 req-4d63597b-d518-4d29-9a0f-c0afdb0296c4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044600 May 25 15:01:58.922924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 268/550] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:59.525303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-7417e15e-5b8d-4c65-a466-6ec75f466384 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:59.525959 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-7417e15e-5b8d-4c65-a466-6ec75f466384 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:59.532348 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7417e15e-5b8d-4c65-a466-6ec75f466384 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:59.532786 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7417e15e-5b8d-4c65-a466-6ec75f466384 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:59.533556 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7417e15e-5b8d-4c65-a466-6ec75f466384 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:59.533988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7417e15e-5b8d-4c65-a466-6ec75f466384 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:59.693669 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-7417e15e-5b8d-4c65-a466-6ec75f466384 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:59.702353 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-7417e15e-5b8d-4c65-a466-6ec75f466384 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 200 len: 1362 microversion: 2.1 time: 0.181365 May 25 15:01:59.702933 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 283/551] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:01:59 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:00.720370 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d3b7e8d6-40c3-441b-8482-914e1198d42a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:00.721101 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d3b7e8d6-40c3-441b-8482-914e1198d42a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:00.728418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d3b7e8d6-40c3-441b-8482-914e1198d42a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:00.728874 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d3b7e8d6-40c3-441b-8482-914e1198d42a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:00.729648 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d3b7e8d6-40c3-441b-8482-914e1198d42a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:00.730110 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d3b7e8d6-40c3-441b-8482-914e1198d42a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:00.866825 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d3b7e8d6-40c3-441b-8482-914e1198d42a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:00.874925 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d3b7e8d6-40c3-441b-8482-914e1198d42a tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 200 len: 1362 microversion: 2.1 time: 0.159143 May 25 15:02:00.875542 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 269/552] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:00 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:01.891532 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b86c7606-3b3a-4703-866c-c690213b327d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:01.892148 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-b86c7606-3b3a-4703-866c-c690213b327d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:01.899097 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b86c7606-3b3a-4703-866c-c690213b327d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:01.899568 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b86c7606-3b3a-4703-866c-c690213b327d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:01.900358 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b86c7606-3b3a-4703-866c-c690213b327d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:01.900792 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b86c7606-3b3a-4703-866c-c690213b327d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:02.039289 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-b86c7606-3b3a-4703-866c-c690213b327d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:02.047226 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-b86c7606-3b3a-4703-866c-c690213b327d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 200 len: 1362 microversion: 2.1 time: 0.159541 May 25 15:02:02.047806 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 284/553] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:01 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:03.064603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-712aef06-7919-4552-82d2-29007ea733a7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:03.065190 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-712aef06-7919-4552-82d2-29007ea733a7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:03.072207 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-712aef06-7919-4552-82d2-29007ea733a7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:03.072649 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-712aef06-7919-4552-82d2-29007ea733a7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:03.073398 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-712aef06-7919-4552-82d2-29007ea733a7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:03.073827 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-712aef06-7919-4552-82d2-29007ea733a7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:03.199802 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-712aef06-7919-4552-82d2-29007ea733a7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:03.207884 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-712aef06-7919-4552-82d2-29007ea733a7 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 200 len: 1362 microversion: 2.1 time: 0.147102 May 25 15:02:03.208450 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 270/554] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:03 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:04.224740 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e80e28d6-6cc2-401d-a8e8-664aff20253e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:04.225260 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e80e28d6-6cc2-401d-a8e8-664aff20253e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:04.232102 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e80e28d6-6cc2-401d-a8e8-664aff20253e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:04.232551 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e80e28d6-6cc2-401d-a8e8-664aff20253e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:04.233319 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e80e28d6-6cc2-401d-a8e8-664aff20253e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:04.233844 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e80e28d6-6cc2-401d-a8e8-664aff20253e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:04.364824 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e80e28d6-6cc2-401d-a8e8-664aff20253e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:04.372226 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e80e28d6-6cc2-401d-a8e8-664aff20253e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 200 len: 1362 microversion: 2.1 time: 0.151439 May 25 15:02:04.372793 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 285/555] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:04 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:05.389491 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7fa6b610-5d92-49d0-b357-8859252f7aa9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:05.390176 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7fa6b610-5d92-49d0-b357-8859252f7aa9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:05.396852 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7fa6b610-5d92-49d0-b357-8859252f7aa9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:05.397297 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7fa6b610-5d92-49d0-b357-8859252f7aa9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:05.398131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7fa6b610-5d92-49d0-b357-8859252f7aa9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:05.398561 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7fa6b610-5d92-49d0-b357-8859252f7aa9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:05.533636 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7fa6b610-5d92-49d0-b357-8859252f7aa9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:05.541775 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7fa6b610-5d92-49d0-b357-8859252f7aa9 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 200 len: 1362 microversion: 2.1 time: 0.156325 May 25 15:02:05.542398 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 271/556] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:05 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:05.847220 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-2111c9a8-5dd8-4870-baaf-f1844514026d req-e8f4cf3b-3c09-46ad-a55c-24839daeddd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c199bd9-ce9c-4761-9f84-042971621d9c", "name": "network-vif-plugged", "status": "completed", "tag": "e879175d-ad6e-45f8-890b-d64ddeb1ddf4"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:05.856557 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-2111c9a8-5dd8-4870-baaf-f1844514026d req-e8f4cf3b-3c09-46ad-a55c-24839daeddd0 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:05.856872 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-2111c9a8-5dd8-4870-baaf-f1844514026d req-e8f4cf3b-3c09-46ad-a55c-24839daeddd0 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:05.868932 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-2111c9a8-5dd8-4870-baaf-f1844514026d req-e8f4cf3b-3c09-46ad-a55c-24839daeddd0 service nova] Creating event network-vif-plugged:e879175d-ad6e-45f8-890b-d64ddeb1ddf4 for instance 0c199bd9-ce9c-4761-9f84-042971621d9c on hv-cinder-80382 May 25 15:02:05.874141 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-2111c9a8-5dd8-4870-baaf-f1844514026d req-e8f4cf3b-3c09-46ad-a55c-24839daeddd0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090475 May 25 15:02:05.874680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 286/557] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:06.559004 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-e128c242-4f3c-4cd6-a4c3-fc1663c2acc4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:06.559615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-e128c242-4f3c-4cd6-a4c3-fc1663c2acc4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:06.561604 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:06.562295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=6 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:06.568468 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e128c242-4f3c-4cd6-a4c3-fc1663c2acc4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:06.568946 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e128c242-4f3c-4cd6-a4c3-fc1663c2acc4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:06.569710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e128c242-4f3c-4cd6-a4c3-fc1663c2acc4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:06.570181 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e128c242-4f3c-4cd6-a4c3-fc1663c2acc4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:06.696070 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-e128c242-4f3c-4cd6-a4c3-fc1663c2acc4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:06.704194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-e128c242-4f3c-4cd6-a4c3-fc1663c2acc4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 200 len: 1362 microversion: 2.1 time: 0.149025 May 25 15:02:06.704758 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 272/558] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:06 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:07.718199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=6 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:07.722430 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-cc160f25-5a9c-4441-adf0-42000908eaf2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:07.723146 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-cc160f25-5a9c-4441-adf0-42000908eaf2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:07.733152 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cc160f25-5a9c-4441-adf0-42000908eaf2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:07.734127 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cc160f25-5a9c-4441-adf0-42000908eaf2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:07.735088 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cc160f25-5a9c-4441-adf0-42000908eaf2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:07.735635 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cc160f25-5a9c-4441-adf0-42000908eaf2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:07.881887 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-cc160f25-5a9c-4441-adf0-42000908eaf2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:07.889870 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-cc160f25-5a9c-4441-adf0-42000908eaf2 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 200 len: 1362 microversion: 2.1 time: 0.172872 May 25 15:02:07.890477 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 287/559] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:07 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:08.907154 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-242ad65f-4912-4eb1-a0e2-5f93733a6e44 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:08.907771 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-242ad65f-4912-4eb1-a0e2-5f93733a6e44 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:08.914344 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-242ad65f-4912-4eb1-a0e2-5f93733a6e44 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:08.914797 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-242ad65f-4912-4eb1-a0e2-5f93733a6e44 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:08.916088 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-242ad65f-4912-4eb1-a0e2-5f93733a6e44 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:08.916522 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-242ad65f-4912-4eb1-a0e2-5f93733a6e44 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:09.045152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-242ad65f-4912-4eb1-a0e2-5f93733a6e44 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:09.052609 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-242ad65f-4912-4eb1-a0e2-5f93733a6e44 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 200 len: 1546 microversion: 2.1 time: 0.149334 May 25 15:02:09.053367 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 273/560] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:08 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:09.069632 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-76acb826-fca5-4317-a28a-d12314aad6d4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:09.070208 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-76acb826-fca5-4317-a28a-d12314aad6d4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:09.076340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-76acb826-fca5-4317-a28a-d12314aad6d4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:09.076787 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-76acb826-fca5-4317-a28a-d12314aad6d4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:09.077547 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-76acb826-fca5-4317-a28a-d12314aad6d4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:09.077983 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-76acb826-fca5-4317-a28a-d12314aad6d4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:09.156658 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-76acb826-fca5-4317-a28a-d12314aad6d4 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091092 May 25 15:02:09.157190 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 288/561] 10.222.0.78 () {58 vars in 1274 bytes} [Wed May 25 15:02:09 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:02:10.176672 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-85114c4c-d3d4-4678-91c9-12edff362e9a req-3c81afa0-075a-4f1d-b57c-9421e35c797f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c199bd9-ce9c-4761-9f84-042971621d9c", "tag": "e879175d-ad6e-45f8-890b-d64ddeb1ddf4"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:10.185587 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-85114c4c-d3d4-4678-91c9-12edff362e9a req-3c81afa0-075a-4f1d-b57c-9421e35c797f service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:10.186301 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-85114c4c-d3d4-4678-91c9-12edff362e9a req-3c81afa0-075a-4f1d-b57c-9421e35c797f service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:10.203404 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-85114c4c-d3d4-4678-91c9-12edff362e9a req-3c81afa0-075a-4f1d-b57c-9421e35c797f service nova] Creating event network-changed:e879175d-ad6e-45f8-890b-d64ddeb1ddf4 for instance 0c199bd9-ce9c-4761-9f84-042971621d9c on hv-cinder-80382 May 25 15:02:10.209383 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-85114c4c-d3d4-4678-91c9-12edff362e9a req-3c81afa0-075a-4f1d-b57c-9421e35c797f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102006 May 25 15:02:10.209992 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 274/562] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:18.539618 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-cf453688-2b05-4ae0-9f41-903b5a71a59a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:18.540132 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-cf453688-2b05-4ae0-9f41-903b5a71a59a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:18.542600 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:18.548904 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cf453688-2b05-4ae0-9f41-903b5a71a59a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:18.549354 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cf453688-2b05-4ae0-9f41-903b5a71a59a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:18.550169 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cf453688-2b05-4ae0-9f41-903b5a71a59a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:18.550614 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cf453688-2b05-4ae0-9f41-903b5a71a59a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:18.553837 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:18.635532 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.objects.instance [None req-cf453688-2b05-4ae0-9f41-903b5a71a59a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lazy-loading 'services' on Instance uuid 58a68392-711b-4106-990e-f6ad82525d59 {{(pid=124523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:02:18.707337 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-cf453688-2b05-4ae0-9f41-903b5a71a59a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "DELETE /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/os-volume_attachments/20855e94-0219-403a-87ff-754990affb7e" status: 202 len: 0 microversion: 2.1 time: 0.171528 May 25 15:02:18.707967 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 289/563] 10.222.0.78 () {58 vars in 1415 bytes} [Wed May 25 15:02:18 2022] DELETE /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/os-volume_attachments/20855e94-0219-403a-87ff-754990affb7e => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:02:18.718096 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-fa4da5f8-490a-4bc3-bbe6-fb2188332dc8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:18.719122 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-fa4da5f8-490a-4bc3-bbe6-fb2188332dc8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:18.721093 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:18.726797 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fa4da5f8-490a-4bc3-bbe6-fb2188332dc8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:18.727312 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fa4da5f8-490a-4bc3-bbe6-fb2188332dc8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:18.728256 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fa4da5f8-490a-4bc3-bbe6-fb2188332dc8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:18.728687 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fa4da5f8-490a-4bc3-bbe6-fb2188332dc8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:18.733593 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=63 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:18.760746 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-fa4da5f8-490a-4bc3-bbe6-fb2188332dc8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048048 May 25 15:02:18.761235 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 275/564] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:02:18 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:02:19.773007 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-dcf42b61-eeab-4d3b-9437-cfc115c3f1e9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:19.774110 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-dcf42b61-eeab-4d3b-9437-cfc115c3f1e9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:19.781050 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dcf42b61-eeab-4d3b-9437-cfc115c3f1e9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:19.781501 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dcf42b61-eeab-4d3b-9437-cfc115c3f1e9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:19.782308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dcf42b61-eeab-4d3b-9437-cfc115c3f1e9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:19.782738 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dcf42b61-eeab-4d3b-9437-cfc115c3f1e9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:19.812248 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-dcf42b61-eeab-4d3b-9437-cfc115c3f1e9 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043637 May 25 15:02:19.812803 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 290/565] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:02:19 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:20.823803 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-cfc16bc6-4c7c-4490-8e0d-e488070a4159 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:20.824847 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-cfc16bc6-4c7c-4490-8e0d-e488070a4159 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:20.831607 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cfc16bc6-4c7c-4490-8e0d-e488070a4159 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:20.832057 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cfc16bc6-4c7c-4490-8e0d-e488070a4159 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:20.832828 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cfc16bc6-4c7c-4490-8e0d-e488070a4159 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:20.833266 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cfc16bc6-4c7c-4490-8e0d-e488070a4159 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:20.863228 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-cfc16bc6-4c7c-4490-8e0d-e488070a4159 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043387 May 25 15:02:20.863795 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 276/566] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:02:20 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:02:20.936211 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-398d8ea1-8fa4-4219-b308-dca6404009bf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:20.937018 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-398d8ea1-8fa4-4219-b308-dca6404009bf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:20.943276 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-398d8ea1-8fa4-4219-b308-dca6404009bf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:20.943727 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-398d8ea1-8fa4-4219-b308-dca6404009bf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:20.944491 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-398d8ea1-8fa4-4219-b308-dca6404009bf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:20.944928 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-398d8ea1-8fa4-4219-b308-dca6404009bf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:20.971815 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-398d8ea1-8fa4-4219-b308-dca6404009bf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Going to try to terminate instance {{(pid=124523) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:02:21.060749 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-398d8ea1-8fa4-4219-b308-dca6404009bf tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "DELETE /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 204 len: 0 microversion: 2.1 time: 0.128674 May 25 15:02:21.061454 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 291/567] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:02:20 2022] DELETE /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:02:21.069989 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-e1bd311e-cee3-4de3-a25f-3bb3bc3de5c5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:21.070734 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-e1bd311e-cee3-4de3-a25f-3bb3bc3de5c5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:21.077718 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e1bd311e-cee3-4de3-a25f-3bb3bc3de5c5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:21.078297 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e1bd311e-cee3-4de3-a25f-3bb3bc3de5c5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:21.079081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e1bd311e-cee3-4de3-a25f-3bb3bc3de5c5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:21.079517 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e1bd311e-cee3-4de3-a25f-3bb3bc3de5c5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:21.211349 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-e1bd311e-cee3-4de3-a25f-3bb3bc3de5c5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:21.219497 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-e1bd311e-cee3-4de3-a25f-3bb3bc3de5c5 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1687 microversion: 2.1 time: 0.153739 May 25 15:02:21.220067 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 277/568] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:21 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:22.237256 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-13201e5d-b6d5-471f-8605-49e7f49c45c4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:22.237975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-13201e5d-b6d5-471f-8605-49e7f49c45c4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:22.244114 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-13201e5d-b6d5-471f-8605-49e7f49c45c4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:22.244561 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-13201e5d-b6d5-471f-8605-49e7f49c45c4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:22.245325 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-13201e5d-b6d5-471f-8605-49e7f49c45c4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:22.245764 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-13201e5d-b6d5-471f-8605-49e7f49c45c4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:22.331221 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-680edb2d-e943-4520-96fb-57c34ac92045 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:22.331724 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-680edb2d-e943-4520-96fb-57c34ac92045 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:22.338549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-680edb2d-e943-4520-96fb-57c34ac92045 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:22.339000 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-680edb2d-e943-4520-96fb-57c34ac92045 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:22.339768 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-680edb2d-e943-4520-96fb-57c34ac92045 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:22.340200 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-680edb2d-e943-4520-96fb-57c34ac92045 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:22.364205 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-680edb2d-e943-4520-96fb-57c34ac92045 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/ips" status: 200 len: 151 microversion: 2.1 time: 0.090121 May 25 15:02:22.364792 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 278/569] 10.222.0.78 () {58 vars in 1247 bytes} [Wed May 25 15:02:22 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/ips => generated 151 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:02:22.383897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-13201e5d-b6d5-471f-8605-49e7f49c45c4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:22.392367 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-13201e5d-b6d5-471f-8605-49e7f49c45c4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1687 microversion: 2.1 time: 0.159744 May 25 15:02:22.392975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 292/570] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:22 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:23.409679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-ff8fbe89-c34e-45f5-ac40-88fdc5c89448 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:23.410316 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-ff8fbe89-c34e-45f5-ac40-88fdc5c89448 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:23.417476 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ff8fbe89-c34e-45f5-ac40-88fdc5c89448 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:23.417926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ff8fbe89-c34e-45f5-ac40-88fdc5c89448 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:23.418725 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ff8fbe89-c34e-45f5-ac40-88fdc5c89448 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:23.419164 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ff8fbe89-c34e-45f5-ac40-88fdc5c89448 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:23.546742 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-ff8fbe89-c34e-45f5-ac40-88fdc5c89448 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:23.554361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-ff8fbe89-c34e-45f5-ac40-88fdc5c89448 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1687 microversion: 2.1 time: 0.148485 May 25 15:02:23.554923 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 279/571] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:23 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1687 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:23.684004 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3f36861a-ca02-4f97-9035-d0ad07c282e4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2150a0ee-1b03-4c85-bd07-580fd60e65a8"}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:23.686147 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-3f36861a-ca02-4f97-9035-d0ad07c282e4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:23.695967 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3f36861a-ca02-4f97-9035-d0ad07c282e4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:23.696411 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3f36861a-ca02-4f97-9035-d0ad07c282e4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:23.697848 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3f36861a-ca02-4f97-9035-d0ad07c282e4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:23.698317 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3f36861a-ca02-4f97-9035-d0ad07c282e4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:24.571223 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d989ffe9-0488-480b-93ba-3b7b1e943132 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:24.571835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d989ffe9-0488-480b-93ba-3b7b1e943132 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:24.578992 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d989ffe9-0488-480b-93ba-3b7b1e943132 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:24.579446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d989ffe9-0488-480b-93ba-3b7b1e943132 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:24.580214 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d989ffe9-0488-480b-93ba-3b7b1e943132 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:24.580649 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d989ffe9-0488-480b-93ba-3b7b1e943132 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:24.710722 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d989ffe9-0488-480b-93ba-3b7b1e943132 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:24.718160 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d989ffe9-0488-480b-93ba-3b7b1e943132 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1687 microversion: 2.1 time: 0.150808 May 25 15:02:24.718721 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 280/572] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:24 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:02:25.641506 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3f36861a-ca02-4f97-9035-d0ad07c282e4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "POST /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.961683 May 25 15:02:25.642477 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 293/573] 10.222.0.78 () {60 vars in 1322 bytes} [Wed May 25 15:02:23 2022] POST /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments => generated 194 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:25.734783 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0ace4ff4-7a16-49ed-aa56-96b102d9c509 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:25.735386 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0ace4ff4-7a16-49ed-aa56-96b102d9c509 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:25.742000 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0ace4ff4-7a16-49ed-aa56-96b102d9c509 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:25.742478 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0ace4ff4-7a16-49ed-aa56-96b102d9c509 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:25.743238 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0ace4ff4-7a16-49ed-aa56-96b102d9c509 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:25.743678 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0ace4ff4-7a16-49ed-aa56-96b102d9c509 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:25.875530 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-0ace4ff4-7a16-49ed-aa56-96b102d9c509 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:25.883262 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0ace4ff4-7a16-49ed-aa56-96b102d9c509 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1687 microversion: 2.1 time: 0.152334 May 25 15:02:25.883823 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 281/574] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:25 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:26.902554 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-472c7320-9cd9-4008-b50e-ea69e8c48e0b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:26.903354 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-472c7320-9cd9-4008-b50e-ea69e8c48e0b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:26.910939 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-472c7320-9cd9-4008-b50e-ea69e8c48e0b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:26.911468 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-472c7320-9cd9-4008-b50e-ea69e8c48e0b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:26.912333 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-472c7320-9cd9-4008-b50e-ea69e8c48e0b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:26.912830 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-472c7320-9cd9-4008-b50e-ea69e8c48e0b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:27.010973 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-472c7320-9cd9-4008-b50e-ea69e8c48e0b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:27.020735 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-472c7320-9cd9-4008-b50e-ea69e8c48e0b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 200 len: 1620 microversion: 2.1 time: 0.123466 May 25 15:02:27.027348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-49ed7149-03f1-4bae-ab53-7f2a7941dc76 req-03b6f3c2-e437-4dbf-9659-c6056e4d75d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a68392-711b-4106-990e-f6ad82525d59", "name": "network-vif-deleted", "tag": "219ede9e-3779-4194-a09a-08090b45e691"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:27.027854 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 294/575] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:26 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 1620 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:27.030839 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-49ed7149-03f1-4bae-ab53-7f2a7941dc76 req-03b6f3c2-e437-4dbf-9659-c6056e4d75d2 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:27.031302 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-49ed7149-03f1-4bae-ab53-7f2a7941dc76 req-03b6f3c2-e437-4dbf-9659-c6056e4d75d2 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:27.042881 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-49ed7149-03f1-4bae-ab53-7f2a7941dc76 req-03b6f3c2-e437-4dbf-9659-c6056e4d75d2 service nova] Creating event network-vif-deleted:219ede9e-3779-4194-a09a-08090b45e691 for instance 58a68392-711b-4106-990e-f6ad82525d59 on hv-cinder-80382 May 25 15:02:27.048083 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-49ed7149-03f1-4bae-ab53-7f2a7941dc76 req-03b6f3c2-e437-4dbf-9659-c6056e4d75d2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029912 May 25 15:02:27.050328 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 282/576] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:02:28.038904 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-1a3563d1-ae97-4dbd-b64c-5d44f71b3346 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:28.039544 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-1a3563d1-ae97-4dbd-b64c-5d44f71b3346 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 58a68392-711b-4106-990e-f6ad82525d59] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:28.047538 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1a3563d1-ae97-4dbd-b64c-5d44f71b3346 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:28.047988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1a3563d1-ae97-4dbd-b64c-5d44f71b3346 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:28.048961 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1a3563d1-ae97-4dbd-b64c-5d44f71b3346 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:28.049601 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1a3563d1-ae97-4dbd-b64c-5d44f71b3346 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:28.064400 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-1a3563d1-ae97-4dbd-b64c-5d44f71b3346 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] HTTP exception thrown: Instance 58a68392-711b-4106-990e-f6ad82525d59 could not be found. May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-1a3563d1-ae97-4dbd-b64c-5d44f71b3346 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Request method failure captured: May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 HTTP/1.1 May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkOQmzSr_Z_HaubRx-8K0J1aivmzZNuHz2evwqGBpOEbVW_8T5qrSA5J06do9eAUOA11aw7skoO4YnbInUibqk41nPye7EGvIZtAObWYp0uJQiTEIBAVIL8lmFYJs7jq459Lvk6nm7QXpTp2CW9MWVgJbxByPFp56Fy8X_ZzDq-0ZWA May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: acd27057280d4bdda5b9a689a1e399ff May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1162490831 May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:02:28.066077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:02:28.067653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_acd27057280d4bdda5b9a689a1e399ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/acd27057280d4bdda5b9a689a1e399ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/acd27057280d4bdda5b9a689a1e399ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/acd27057280d4bdda5b9a689a1e399ff"}]}] May 25 15:02:28.067653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1162490831 May 25 15:02:28.067653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: acd27057280d4bdda5b9a689a1e399ff May 25 15:02:28.067653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1162490831 May 25 15:02:28.067653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-ServerRescueNegativeTestJSON-1162490831-project May 25 15:02:28.067653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:02:28.067653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:02:28.067653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: 97011bf8f6d444468fecdde7acfa1020 May 25 15:02:28.067653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1162490831-project May 25 15:02:28.067653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:02:28.067653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance 58a68392-711b-4106-990e-f6ad82525d59 could not be found. May 25 15:02:28.067653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': '58a68392-711b-4106-990e-f6ad82525d59'} May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58a68392-711b-4106-990e-f6ad82525d59 could not be found. May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:02:28.069030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:02:28.070641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:02:28.070641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:02:28.070641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:02:28.070641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:02:28.070641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:02:28.070641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:02:28.070641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:02:28.070641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58a68392-711b-4106-990e-f6ad82525d59 could not be found. May 25 15:02:28.070641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:28.070641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:28.070641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:28.070641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:28.070641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:28.070641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:28.070641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:02:28.070641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:02:28.070641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58a68392-711b-4106-990e-f6ad82525d59 could not be found. May 25 15:02:28.070641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:28.072061 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-1a3563d1-ae97-4dbd-b64c-5d44f71b3346 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Returning 404 to user: Instance 58a68392-711b-4106-990e-f6ad82525d59 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:02:28.072061 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-1a3563d1-ae97-4dbd-b64c-5d44f71b3346 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59" status: 404 len: 111 microversion: 2.1 time: 0.032632 May 25 15:02:28.072061 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 295/577] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:28 2022] GET /compute/v2.1/servers/58a68392-711b-4106-990e-f6ad82525d59 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:02:28.077579 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-4046a8ef-355d-4b28-a6dd-51d75591fb06 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '.version_select at 0x7fb1db77fdc0>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:28.098002 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-4046a8ef-355d-4b28-a6dd-51d75591fb06 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-655743168" status: 202 len: 0 microversion: 2.1 time: 0.025190 May 25 15:02:28.099051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 283/578] 10.222.0.78 () {58 vars in 1217 bytes} [Wed May 25 15:02:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-655743168 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:02:30.975982 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b0bc9196-f106-4f62-81e2-7f6ed82daf2e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:30.976486 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-b0bc9196-f106-4f62-81e2-7f6ed82daf2e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:30.983724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b0bc9196-f106-4f62-81e2-7f6ed82daf2e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:30.984177 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b0bc9196-f106-4f62-81e2-7f6ed82daf2e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:30.984974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b0bc9196-f106-4f62-81e2-7f6ed82daf2e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:30.985482 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b0bc9196-f106-4f62-81e2-7f6ed82daf2e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:31.011681 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-b0bc9196-f106-4f62-81e2-7f6ed82daf2e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Going to try to terminate instance {{(pid=124523) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:02:31.090195 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-b0bc9196-f106-4f62-81e2-7f6ed82daf2e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "DELETE /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 204 len: 0 microversion: 2.1 time: 0.117758 May 25 15:02:31.094097 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 296/579] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:02:30 2022] DELETE /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:02:31.104719 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2ed6bd72-5c39-4f9b-b9ab-42926b02b6e4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:31.106196 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2ed6bd72-5c39-4f9b-b9ab-42926b02b6e4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:31.114159 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2ed6bd72-5c39-4f9b-b9ab-42926b02b6e4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:31.114631 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2ed6bd72-5c39-4f9b-b9ab-42926b02b6e4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:31.115974 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2ed6bd72-5c39-4f9b-b9ab-42926b02b6e4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:31.115974 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2ed6bd72-5c39-4f9b-b9ab-42926b02b6e4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:31.268680 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-2ed6bd72-5c39-4f9b-b9ab-42926b02b6e4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:31.276645 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2ed6bd72-5c39-4f9b-b9ab-42926b02b6e4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1509 microversion: 2.1 time: 0.180648 May 25 15:02:31.277210 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 284/580] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:31 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:32.294818 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-70db8f7e-fdd3-4d83-82fa-1a7f433a68b6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:32.295512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-70db8f7e-fdd3-4d83-82fa-1a7f433a68b6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:32.302065 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-70db8f7e-fdd3-4d83-82fa-1a7f433a68b6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:32.302513 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-70db8f7e-fdd3-4d83-82fa-1a7f433a68b6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:32.303309 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-70db8f7e-fdd3-4d83-82fa-1a7f433a68b6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:32.303733 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-70db8f7e-fdd3-4d83-82fa-1a7f433a68b6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:32.442433 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-70db8f7e-fdd3-4d83-82fa-1a7f433a68b6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:32.450468 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-70db8f7e-fdd3-4d83-82fa-1a7f433a68b6 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1509 microversion: 2.1 time: 0.160560 May 25 15:02:32.451035 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 297/581] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:32 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:33.057789 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-c3ce304e-dd6c-410e-bf62-82df825d8cfb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:33.057789 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-c3ce304e-dd6c-410e-bf62-82df825d8cfb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:33.064571 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c3ce304e-dd6c-410e-bf62-82df825d8cfb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:33.065010 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c3ce304e-dd6c-410e-bf62-82df825d8cfb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:33.065780 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c3ce304e-dd6c-410e-bf62-82df825d8cfb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:33.066240 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c3ce304e-dd6c-410e-bf62-82df825d8cfb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:33.092178 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-c3ce304e-dd6c-410e-bf62-82df825d8cfb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Going to try to terminate instance {{(pid=124524) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:02:33.171383 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-c3ce304e-dd6c-410e-bf62-82df825d8cfb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 204 len: 0 microversion: 2.1 time: 0.117804 May 25 15:02:33.171955 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 285/582] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:02:33 2022] DELETE /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:02:33.179991 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e3f1ba9e-56d1-4d8e-9199-3c9f2ae5c889 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:33.180598 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e3f1ba9e-56d1-4d8e-9199-3c9f2ae5c889 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:33.186816 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e3f1ba9e-56d1-4d8e-9199-3c9f2ae5c889 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:33.187264 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e3f1ba9e-56d1-4d8e-9199-3c9f2ae5c889 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:33.188022 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e3f1ba9e-56d1-4d8e-9199-3c9f2ae5c889 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:33.188457 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e3f1ba9e-56d1-4d8e-9199-3c9f2ae5c889 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:33.320248 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e3f1ba9e-56d1-4d8e-9199-3c9f2ae5c889 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:33.328852 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e3f1ba9e-56d1-4d8e-9199-3c9f2ae5c889 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1576 microversion: 2.1 time: 0.152594 May 25 15:02:33.329421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 298/583] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:33 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:33.467883 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-f7cffda3-e890-40a8-aba6-26ddac7007f8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:33.468583 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-f7cffda3-e890-40a8-aba6-26ddac7007f8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:33.474774 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f7cffda3-e890-40a8-aba6-26ddac7007f8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:33.475223 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f7cffda3-e890-40a8-aba6-26ddac7007f8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:33.481078 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f7cffda3-e890-40a8-aba6-26ddac7007f8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:33.481078 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f7cffda3-e890-40a8-aba6-26ddac7007f8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:33.610936 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-f7cffda3-e890-40a8-aba6-26ddac7007f8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:33.618416 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-f7cffda3-e890-40a8-aba6-26ddac7007f8 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1509 microversion: 2.1 time: 0.154769 May 25 15:02:33.619176 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 286/584] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:33 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:34.347389 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-845a1b33-2f4b-47f2-932e-f9e3f5a8d52d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:34.348010 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-845a1b33-2f4b-47f2-932e-f9e3f5a8d52d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:34.355163 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-845a1b33-2f4b-47f2-932e-f9e3f5a8d52d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:34.355601 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-845a1b33-2f4b-47f2-932e-f9e3f5a8d52d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:34.356360 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-845a1b33-2f4b-47f2-932e-f9e3f5a8d52d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:34.356786 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-845a1b33-2f4b-47f2-932e-f9e3f5a8d52d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:34.485851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-845a1b33-2f4b-47f2-932e-f9e3f5a8d52d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:34.494203 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-845a1b33-2f4b-47f2-932e-f9e3f5a8d52d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1576 microversion: 2.1 time: 0.150606 May 25 15:02:34.495004 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 299/585] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:34 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:34.637168 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-ce8817b2-7154-4558-9fc8-d988c2ca51b3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:34.637780 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-ce8817b2-7154-4558-9fc8-d988c2ca51b3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:34.644517 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ce8817b2-7154-4558-9fc8-d988c2ca51b3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:34.644962 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ce8817b2-7154-4558-9fc8-d988c2ca51b3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:34.645731 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ce8817b2-7154-4558-9fc8-d988c2ca51b3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:34.646196 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ce8817b2-7154-4558-9fc8-d988c2ca51b3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:34.783947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-ce8817b2-7154-4558-9fc8-d988c2ca51b3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:34.791708 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-ce8817b2-7154-4558-9fc8-d988c2ca51b3 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1509 microversion: 2.1 time: 0.159153 May 25 15:02:34.792281 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 287/586] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:34 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:35.513787 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ebbe4916-56e3-4880-8287-ff8b79b18cdb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:35.514368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ebbe4916-56e3-4880-8287-ff8b79b18cdb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:35.525337 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ebbe4916-56e3-4880-8287-ff8b79b18cdb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:35.526749 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ebbe4916-56e3-4880-8287-ff8b79b18cdb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:35.528055 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ebbe4916-56e3-4880-8287-ff8b79b18cdb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:35.528809 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ebbe4916-56e3-4880-8287-ff8b79b18cdb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:35.783322 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ebbe4916-56e3-4880-8287-ff8b79b18cdb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:35.790045 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ebbe4916-56e3-4880-8287-ff8b79b18cdb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1576 microversion: 2.1 time: 0.280463 May 25 15:02:35.790943 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 300/587] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:35 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1576 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:35.809463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7e205f7a-c352-4428-a2cd-853961189f3b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:35.810777 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7e205f7a-c352-4428-a2cd-853961189f3b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:35.818258 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7e205f7a-c352-4428-a2cd-853961189f3b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:35.819037 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7e205f7a-c352-4428-a2cd-853961189f3b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:35.819821 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7e205f7a-c352-4428-a2cd-853961189f3b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:35.820433 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7e205f7a-c352-4428-a2cd-853961189f3b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:36.060855 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7e205f7a-c352-4428-a2cd-853961189f3b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:36.068852 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7e205f7a-c352-4428-a2cd-853961189f3b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 200 len: 1509 microversion: 2.1 time: 0.263597 May 25 15:02:36.080754 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 288/588] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:35 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:36.101493 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-f45284bf-9c26-423d-8e6b-0bb07223bbeb req-b9b72371-8470-4380-bb48-7558c31f64d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95dc2490-acfb-45bb-b4a6-6bc30f8cf983", "name": "network-vif-deleted", "tag": "9735042b-b98e-4620-bbc8-7f7da435ba26"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:36.110639 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-f45284bf-9c26-423d-8e6b-0bb07223bbeb req-b9b72371-8470-4380-bb48-7558c31f64d7 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:36.111134 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-f45284bf-9c26-423d-8e6b-0bb07223bbeb req-b9b72371-8470-4380-bb48-7558c31f64d7 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:36.122129 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:36.124852 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-f45284bf-9c26-423d-8e6b-0bb07223bbeb req-b9b72371-8470-4380-bb48-7558c31f64d7 service nova] Creating event network-vif-deleted:9735042b-b98e-4620-bbc8-7f7da435ba26 for instance 95dc2490-acfb-45bb-b4a6-6bc30f8cf983 on hv-cinder-80382 May 25 15:02:36.130576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-f45284bf-9c26-423d-8e6b-0bb07223bbeb req-b9b72371-8470-4380-bb48-7558c31f64d7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033158 May 25 15:02:36.131845 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 301/589] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:36.339878 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-17a11a57-cc68-4552-bc30-1f4622c1626e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2150a0ee-1b03-4c85-bd07-580fd60e65a8"}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:36.341075 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-17a11a57-cc68-4552-bc30-1f4622c1626e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:36.346984 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-17a11a57-cc68-4552-bc30-1f4622c1626e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:36.347425 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-17a11a57-cc68-4552-bc30-1f4622c1626e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:36.348260 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-17a11a57-cc68-4552-bc30-1f4622c1626e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:36.348701 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-17a11a57-cc68-4552-bc30-1f4622c1626e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:36.439153 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-17a11a57-cc68-4552-bc30-1f4622c1626e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] HTTP exception thrown: Invalid volume: volume 2150a0ee-1b03-4c85-bd07-580fd60e65a8 is already attached to instances: 0cd834bb-ffdb-40c9-9585-cb81a52a3322 May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-17a11a57-cc68-4552-bc30-1f4622c1626e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Request method failure captured: May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: POST /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments HTTP/1.1 May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 74 May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkOaNMspd4aouSbU1AbWPRZXQpnMIXaZVnqXM_GcJU5QANUYoykKOboFENZqE39ayR7YV98XzJEhmbNMT4xGE2Rmi1LhcZy3xlCFBJXF3aSJNrYEmDnN6WznzrHbbYABEJ1DEPcIqWV1-In6s7XLRv6-66f2Fc-5c9Wz9_np-VTpkmg May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:02:36.440929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:02:36.442534 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}] May 25 15:02:36.442534 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-AttachVolumeNegativeTest-533430010 May 25 15:02:36.442534 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:02:36.442534 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:02:36.442534 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:02:36.442534 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:02:36.442534 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:02:36.442534 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: e60a5e751f22450c8e366c85b37af1f6 May 25 15:02:36.442534 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:02:36.442534 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: May 25 15:02:36.442534 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {"volumeAttachment": {"volumeId": "2150a0ee-1b03-4c85-bd07-580fd60e65a8"}} May 25 15:02:36.442534 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Invalid volume: volume 2150a0ee-1b03-4c85-bd07-580fd60e65a8 is already attached to instances: 0cd834bb-ffdb-40c9-9585-cb81a52a3322 May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'server_id': '0cd834bb-ffdb-40c9-9585-cb81a52a3322', 'body': {'volumeAttachment': {'volumeId': '2150a0ee-1b03-4c85-bd07-580fd60e65a8'}}} May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2150a0ee-1b03-4c85-bd07-580fd60e65a8 is already attached to instances: 0cd834bb-ffdb-40c9-9585-cb81a52a3322 May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:02:36.443446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2150a0ee-1b03-4c85-bd07-580fd60e65a8 is already attached to instances: 0cd834bb-ffdb-40c9-9585-cb81a52a3322 May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:36.445040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:36.447364 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:36.447364 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:02:36.447364 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:02:36.447364 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2150a0ee-1b03-4c85-bd07-580fd60e65a8 is already attached to instances: 0cd834bb-ffdb-40c9-9585-cb81a52a3322 May 25 15:02:36.447364 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:02:36.447364 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-17a11a57-cc68-4552-bc30-1f4622c1626e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Returning 400 to user: Invalid volume: volume 2150a0ee-1b03-4c85-bd07-580fd60e65a8 is already attached to instances: 0cd834bb-ffdb-40c9-9585-cb81a52a3322 {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:02:36.447364 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-17a11a57-cc68-4552-bc30-1f4622c1626e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "POST /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106563 May 25 15:02:36.451395 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 289/590] 10.222.0.78 () {60 vars in 1322 bytes} [Wed May 25 15:02:36 2022] POST /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 25 15:02:36.523581 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e6001b28-2f59-49a6-8e46-1d77f9fe0afb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:36.524265 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e6001b28-2f59-49a6-8e46-1d77f9fe0afb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:36.533384 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e6001b28-2f59-49a6-8e46-1d77f9fe0afb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:36.534300 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e6001b28-2f59-49a6-8e46-1d77f9fe0afb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:36.535091 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e6001b28-2f59-49a6-8e46-1d77f9fe0afb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:36.535532 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e6001b28-2f59-49a6-8e46-1d77f9fe0afb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:36.632804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.objects.instance [None req-e6001b28-2f59-49a6-8e46-1d77f9fe0afb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lazy-loading 'services' on Instance uuid 0cd834bb-ffdb-40c9-9585-cb81a52a3322 {{(pid=124523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:02:36.712022 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e6001b28-2f59-49a6-8e46-1d77f9fe0afb tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments/2150a0ee-1b03-4c85-bd07-580fd60e65a8" status: 202 len: 0 microversion: 2.1 time: 0.193269 May 25 15:02:36.715807 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 302/591] 10.222.0.78 () {58 vars in 1415 bytes} [Wed May 25 15:02:36 2022] DELETE /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments/2150a0ee-1b03-4c85-bd07-580fd60e65a8 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:02:36.724480 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-5d4e1b9d-71b2-4671-8349-61a4000f8601 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:36.738925 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-5d4e1b9d-71b2-4671-8349-61a4000f8601 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:36.759022 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-cf5b947a-039e-4d23-85f7-e8dacd129977 req-b82d9c26-d8a6-4b1c-875c-75d7e359991b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a712db2a-4e2e-46b3-a696-9396ea8c5209", "name": "network-vif-deleted", "tag": "2a1f0f94-24f2-48c9-b837-2cd6a40fd1bc"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:36.765853 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5d4e1b9d-71b2-4671-8349-61a4000f8601 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:36.766505 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5d4e1b9d-71b2-4671-8349-61a4000f8601 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:36.767290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5d4e1b9d-71b2-4671-8349-61a4000f8601 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:36.767431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-cf5b947a-039e-4d23-85f7-e8dacd129977 req-b82d9c26-d8a6-4b1c-875c-75d7e359991b service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:36.767756 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-cf5b947a-039e-4d23-85f7-e8dacd129977 req-b82d9c26-d8a6-4b1c-875c-75d7e359991b service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:36.768139 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5d4e1b9d-71b2-4671-8349-61a4000f8601 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:36.779597 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-cf5b947a-039e-4d23-85f7-e8dacd129977 req-b82d9c26-d8a6-4b1c-875c-75d7e359991b service nova] Creating event network-vif-deleted:2a1f0f94-24f2-48c9-b837-2cd6a40fd1bc for instance a712db2a-4e2e-46b3-a696-9396ea8c5209 on hv-cinder-80382 May 25 15:02:36.784823 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-cf5b947a-039e-4d23-85f7-e8dacd129977 req-b82d9c26-d8a6-4b1c-875c-75d7e359991b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029912 May 25 15:02:36.785574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 303/592] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:36.809557 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4c6df238-e9e2-4f6d-9f83-2e1ac1df9927 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:36.810429 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4c6df238-e9e2-4f6d-9f83-2e1ac1df9927 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:36.815067 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-5d4e1b9d-71b2-4671-8349-61a4000f8601 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097393 May 25 15:02:36.815965 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 290/593] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:02:36 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:36.821902 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4c6df238-e9e2-4f6d-9f83-2e1ac1df9927 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:36.822387 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4c6df238-e9e2-4f6d-9f83-2e1ac1df9927 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:36.823452 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4c6df238-e9e2-4f6d-9f83-2e1ac1df9927 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:36.824234 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4c6df238-e9e2-4f6d-9f83-2e1ac1df9927 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:36.904518 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4c6df238-e9e2-4f6d-9f83-2e1ac1df9927 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:36.919432 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4c6df238-e9e2-4f6d-9f83-2e1ac1df9927 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1508 microversion: 2.1 time: 0.115712 May 25 15:02:36.920647 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 304/594] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:36 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1508 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:02:37.086984 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8927f862-2ef2-4e9b-8bca-ab6b4b18281b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:37.087493 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-8927f862-2ef2-4e9b-8bca-ab6b4b18281b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 95dc2490-acfb-45bb-b4a6-6bc30f8cf983] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:37.094742 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8927f862-2ef2-4e9b-8bca-ab6b4b18281b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:37.095193 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8927f862-2ef2-4e9b-8bca-ab6b4b18281b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:37.095983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8927f862-2ef2-4e9b-8bca-ab6b4b18281b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:37.096479 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8927f862-2ef2-4e9b-8bca-ab6b4b18281b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:37.111372 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-8927f862-2ef2-4e9b-8bca-ab6b4b18281b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] HTTP exception thrown: Instance 95dc2490-acfb-45bb-b4a6-6bc30f8cf983 could not be found. May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8927f862-2ef2-4e9b-8bca-ab6b4b18281b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Request method failure captured: May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 HTTP/1.1 May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkOQmzSr_Z_HaubRx-8K0J1aivmzZNuHz2evwqGBpOEbVW_8T5qrSA5J06do9eAUOA11aw7skoO4YnbInUibqk41nPye7EGvIZtAObWYp0uJQiTEIBAVIL8lmFYJs7jq459Lvk6nm7QXpTp2CW9MWVgJbxByPFp56Fy8X_ZzDq-0ZWA May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: acd27057280d4bdda5b9a689a1e399ff May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1162490831 May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:02:37.112924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:02:37.114397 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_acd27057280d4bdda5b9a689a1e399ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/acd27057280d4bdda5b9a689a1e399ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/acd27057280d4bdda5b9a689a1e399ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/acd27057280d4bdda5b9a689a1e399ff"}]}] May 25 15:02:37.114397 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1162490831 May 25 15:02:37.114397 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: acd27057280d4bdda5b9a689a1e399ff May 25 15:02:37.114397 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1162490831 May 25 15:02:37.114397 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-ServerRescueNegativeTestJSON-1162490831-project May 25 15:02:37.114397 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:02:37.114397 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:02:37.114397 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: 97011bf8f6d444468fecdde7acfa1020 May 25 15:02:37.114397 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1162490831-project May 25 15:02:37.114397 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:02:37.114397 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance 95dc2490-acfb-45bb-b4a6-6bc30f8cf983 could not be found. May 25 15:02:37.114397 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': '95dc2490-acfb-45bb-b4a6-6bc30f8cf983'} May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95dc2490-acfb-45bb-b4a6-6bc30f8cf983 could not be found. May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:02:37.115146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:02:37.116342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:02:37.116342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:02:37.116342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:02:37.116342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:02:37.116342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:02:37.116342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:02:37.116342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:02:37.116342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95dc2490-acfb-45bb-b4a6-6bc30f8cf983 could not be found. May 25 15:02:37.116342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:02:37.116342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:37.116342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:02:37.116342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:37.116342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:37.116342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:37.116342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:02:37.116342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:02:37.116342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95dc2490-acfb-45bb-b4a6-6bc30f8cf983 could not be found. May 25 15:02:37.116342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:02:37.117469 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8927f862-2ef2-4e9b-8bca-ab6b4b18281b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Returning 404 to user: Instance 95dc2490-acfb-45bb-b4a6-6bc30f8cf983 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:02:37.117469 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-8927f862-2ef2-4e9b-8bca-ab6b4b18281b tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983" status: 404 len: 111 microversion: 2.1 time: 0.031401 May 25 15:02:37.117469 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 291/595] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:37 2022] GET /compute/v2.1/servers/95dc2490-acfb-45bb-b4a6-6bc30f8cf983 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:02:37.123490 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4ea4cf66-71f5-4ea7-9f35-325304af0a1a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:37.124025 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4ea4cf66-71f5-4ea7-9f35-325304af0a1a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:37.131214 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4ea4cf66-71f5-4ea7-9f35-325304af0a1a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:37.131689 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4ea4cf66-71f5-4ea7-9f35-325304af0a1a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:37.132750 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4ea4cf66-71f5-4ea7-9f35-325304af0a1a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:37.133193 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4ea4cf66-71f5-4ea7-9f35-325304af0a1a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:37.165227 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4ea4cf66-71f5-4ea7-9f35-325304af0a1a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Going to try to terminate instance {{(pid=124523) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:02:37.254426 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4ea4cf66-71f5-4ea7-9f35-325304af0a1a tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 204 len: 0 microversion: 2.1 time: 0.134576 May 25 15:02:37.255219 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 305/596] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:02:37 2022] DELETE /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:02:37.263347 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1376fb04-3f0e-4b4e-989c-bdf79c292ab4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:37.264043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1376fb04-3f0e-4b4e-989c-bdf79c292ab4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:37.270200 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1376fb04-3f0e-4b4e-989c-bdf79c292ab4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:37.270646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1376fb04-3f0e-4b4e-989c-bdf79c292ab4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:37.271409 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1376fb04-3f0e-4b4e-989c-bdf79c292ab4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:37.271838 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1376fb04-3f0e-4b4e-989c-bdf79c292ab4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:37.408676 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1376fb04-3f0e-4b4e-989c-bdf79c292ab4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:37.411021 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:37.434733 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1376fb04-3f0e-4b4e-989c-bdf79c292ab4 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.173916 May 25 15:02:37.436446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 292/597] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:37 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:02:37.828537 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-c59e8e3d-c0b8-483d-afde-e7d7740521e4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:37.830292 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-c59e8e3d-c0b8-483d-afde-e7d7740521e4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:37.837318 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c59e8e3d-c0b8-483d-afde-e7d7740521e4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:37.837851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c59e8e3d-c0b8-483d-afde-e7d7740521e4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:37.838738 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c59e8e3d-c0b8-483d-afde-e7d7740521e4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:37.839176 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c59e8e3d-c0b8-483d-afde-e7d7740521e4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:37.871519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-c59e8e3d-c0b8-483d-afde-e7d7740521e4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048290 May 25 15:02:37.872089 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 306/598] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:02:37 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:37.937781 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-184dad25-19a6-48c6-a98d-a161daf418b5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:37.938696 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-184dad25-19a6-48c6-a98d-a161daf418b5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:37.945656 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-184dad25-19a6-48c6-a98d-a161daf418b5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:37.946173 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-184dad25-19a6-48c6-a98d-a161daf418b5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:37.946946 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-184dad25-19a6-48c6-a98d-a161daf418b5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:37.947388 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-184dad25-19a6-48c6-a98d-a161daf418b5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:37.979582 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-184dad25-19a6-48c6-a98d-a161daf418b5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:37.980034 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-184dad25-19a6-48c6-a98d-a161daf418b5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:37.980483 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-184dad25-19a6-48c6-a98d-a161daf418b5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lazy-loading 'fault' on Instance uuid a712db2a-4e2e-46b3-a696-9396ea8c5209 {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:02:38.021166 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-184dad25-19a6-48c6-a98d-a161daf418b5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:38.028885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-184dad25-19a6-48c6-a98d-a161daf418b5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1230 microversion: 2.1 time: 0.095407 May 25 15:02:38.029448 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 293/599] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:37 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:38.452924 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0b37a01c-b6dc-44d8-b522-c84fe1fc286e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:38.453534 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-0b37a01c-b6dc-44d8-b522-c84fe1fc286e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:38.459669 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0b37a01c-b6dc-44d8-b522-c84fe1fc286e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:38.460117 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0b37a01c-b6dc-44d8-b522-c84fe1fc286e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:38.460883 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0b37a01c-b6dc-44d8-b522-c84fe1fc286e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:38.461320 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0b37a01c-b6dc-44d8-b522-c84fe1fc286e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:38.590923 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-0b37a01c-b6dc-44d8-b522-c84fe1fc286e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:38.598661 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-0b37a01c-b6dc-44d8-b522-c84fe1fc286e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.149560 May 25 15:02:38.599239 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 307/600] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:38 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:38.883428 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8cd6b3eb-2c4e-4d3c-a2da-5221b69bb57f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:38.884454 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-8cd6b3eb-2c4e-4d3c-a2da-5221b69bb57f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:38.891152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8cd6b3eb-2c4e-4d3c-a2da-5221b69bb57f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:38.891599 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8cd6b3eb-2c4e-4d3c-a2da-5221b69bb57f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:38.892368 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8cd6b3eb-2c4e-4d3c-a2da-5221b69bb57f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:38.892811 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8cd6b3eb-2c4e-4d3c-a2da-5221b69bb57f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:38.923127 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-8cd6b3eb-2c4e-4d3c-a2da-5221b69bb57f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043853 May 25 15:02:38.923689 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 294/601] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:02:38 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:39.050076 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8821819b-e8a2-47a2-9ddd-39d69df8bca2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:39.050828 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8821819b-e8a2-47a2-9ddd-39d69df8bca2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:39.057419 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8821819b-e8a2-47a2-9ddd-39d69df8bca2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:39.058473 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8821819b-e8a2-47a2-9ddd-39d69df8bca2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:39.059257 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8821819b-e8a2-47a2-9ddd-39d69df8bca2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:39.059726 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8821819b-e8a2-47a2-9ddd-39d69df8bca2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:39.091487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8821819b-e8a2-47a2-9ddd-39d69df8bca2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:39.091935 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8821819b-e8a2-47a2-9ddd-39d69df8bca2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:39.092392 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.objects.instance [None req-8821819b-e8a2-47a2-9ddd-39d69df8bca2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lazy-loading 'fault' on Instance uuid a712db2a-4e2e-46b3-a696-9396ea8c5209 {{(pid=124523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:02:39.137464 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8821819b-e8a2-47a2-9ddd-39d69df8bca2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:39.144968 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8821819b-e8a2-47a2-9ddd-39d69df8bca2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1230 microversion: 2.1 time: 0.103050 May 25 15:02:39.145537 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 308/602] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:39 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:39.616194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-3db365e4-d38b-4c74-9be8-9db77147680e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:39.616809 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-3db365e4-d38b-4c74-9be8-9db77147680e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:39.622928 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3db365e4-d38b-4c74-9be8-9db77147680e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:39.623378 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3db365e4-d38b-4c74-9be8-9db77147680e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:39.624139 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3db365e4-d38b-4c74-9be8-9db77147680e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:39.624574 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3db365e4-d38b-4c74-9be8-9db77147680e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:39.751799 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3db365e4-d38b-4c74-9be8-9db77147680e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:39.759610 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-3db365e4-d38b-4c74-9be8-9db77147680e tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.147394 May 25 15:02:39.760165 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 295/603] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:39 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:39.934068 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4bf43e0c-c1a2-4d60-9e37-feae4bebfedd tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:39.935059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4bf43e0c-c1a2-4d60-9e37-feae4bebfedd tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:39.941216 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4bf43e0c-c1a2-4d60-9e37-feae4bebfedd tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:39.941668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4bf43e0c-c1a2-4d60-9e37-feae4bebfedd tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:39.942458 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4bf43e0c-c1a2-4d60-9e37-feae4bebfedd tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:39.942892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4bf43e0c-c1a2-4d60-9e37-feae4bebfedd tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:39.974374 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4bf43e0c-c1a2-4d60-9e37-feae4bebfedd tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044205 May 25 15:02:39.974944 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 309/604] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:02:39 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:40.161834 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-893ee2e7-33f7-4aa0-bcfd-d014c9919476 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:40.162393 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-893ee2e7-33f7-4aa0-bcfd-d014c9919476 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:40.169400 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-893ee2e7-33f7-4aa0-bcfd-d014c9919476 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:40.169850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-893ee2e7-33f7-4aa0-bcfd-d014c9919476 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:40.170676 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-893ee2e7-33f7-4aa0-bcfd-d014c9919476 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:40.171109 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-893ee2e7-33f7-4aa0-bcfd-d014c9919476 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:40.207013 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-893ee2e7-33f7-4aa0-bcfd-d014c9919476 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:40.207679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-893ee2e7-33f7-4aa0-bcfd-d014c9919476 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:40.208200 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-893ee2e7-33f7-4aa0-bcfd-d014c9919476 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lazy-loading 'fault' on Instance uuid a712db2a-4e2e-46b3-a696-9396ea8c5209 {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:02:40.251493 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-893ee2e7-33f7-4aa0-bcfd-d014c9919476 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:40.259324 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-893ee2e7-33f7-4aa0-bcfd-d014c9919476 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 200 len: 1230 microversion: 2.1 time: 0.101610 May 25 15:02:40.259998 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 296/605] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:40 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:40.777300 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8dd04664-6f26-46fe-92e7-c9ee1220835c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:40.778647 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8dd04664-6f26-46fe-92e7-c9ee1220835c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:40.784995 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8dd04664-6f26-46fe-92e7-c9ee1220835c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:40.785532 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8dd04664-6f26-46fe-92e7-c9ee1220835c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:40.786558 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8dd04664-6f26-46fe-92e7-c9ee1220835c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:40.787075 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8dd04664-6f26-46fe-92e7-c9ee1220835c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:40.935494 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8dd04664-6f26-46fe-92e7-c9ee1220835c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:40.943301 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8dd04664-6f26-46fe-92e7-c9ee1220835c tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1522 microversion: 2.1 time: 0.170468 May 25 15:02:40.943873 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 310/606] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:40 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:40.985659 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-e4cf3cf4-bff9-4a9d-aeba-190737da24a3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:40.986784 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-e4cf3cf4-bff9-4a9d-aeba-190737da24a3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:40.992808 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e4cf3cf4-bff9-4a9d-aeba-190737da24a3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:40.993260 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e4cf3cf4-bff9-4a9d-aeba-190737da24a3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:40.994379 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e4cf3cf4-bff9-4a9d-aeba-190737da24a3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:40.994823 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e4cf3cf4-bff9-4a9d-aeba-190737da24a3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:41.024958 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-e4cf3cf4-bff9-4a9d-aeba-190737da24a3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043216 May 25 15:02:41.029626 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 297/607] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:02:40 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:41.277580 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-28e4f062-afbb-4323-8fb5-699d7831f676 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:41.278389 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-28e4f062-afbb-4323-8fb5-699d7831f676 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:41.289023 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-28e4f062-afbb-4323-8fb5-699d7831f676 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:41.289557 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-28e4f062-afbb-4323-8fb5-699d7831f676 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:41.290284 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-28e4f062-afbb-4323-8fb5-699d7831f676 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:41.290793 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-28e4f062-afbb-4323-8fb5-699d7831f676 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:41.305979 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-28e4f062-afbb-4323-8fb5-699d7831f676 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] HTTP exception thrown: Instance a712db2a-4e2e-46b3-a696-9396ea8c5209 could not be found. May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-28e4f062-afbb-4323-8fb5-699d7831f676 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Request method failure captured: May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 HTTP/1.1 May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkQ1prV8xU0Wo0Y4voiA4DMrSg8qtdpeFKsCNklPCcf4DhabLsXL6QoAbAPuEwQRJiIWdvqkyI-hcw3ve1R5P0sRHip2fx88sEnqgX_8vHJUlAZaRUFEpLg41eBW6uQegRbLJUSLaGoRBuQfVwMwipnGrfsThgts1b4ydwmnC9XN6NU May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 99281bdc8f6340a1be03774c255ae4ba May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-TestVolumeBootPattern-150097606 May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:02:41.307687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:02:41.309225 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_99281bdc8f6340a1be03774c255ae4ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/99281bdc8f6340a1be03774c255ae4ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99281bdc8f6340a1be03774c255ae4ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99281bdc8f6340a1be03774c255ae4ba"}]}] May 25 15:02:41.309225 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-TestVolumeBootPattern-150097606 May 25 15:02:41.309225 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 99281bdc8f6340a1be03774c255ae4ba May 25 15:02:41.309225 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-TestVolumeBootPattern-150097606 May 25 15:02:41.309225 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-TestVolumeBootPattern-150097606-project May 25 15:02:41.309225 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:02:41.309225 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:02:41.309225 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: daec78050ee547699910603eff8cb7ca May 25 15:02:41.309225 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-TestVolumeBootPattern-150097606-project May 25 15:02:41.309225 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:02:41.309225 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance a712db2a-4e2e-46b3-a696-9396ea8c5209 could not be found. May 25 15:02:41.309225 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': 'a712db2a-4e2e-46b3-a696-9396ea8c5209'} May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a712db2a-4e2e-46b3-a696-9396ea8c5209 could not be found. May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:02:41.310080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:02:41.311340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:02:41.311340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:02:41.311340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:02:41.311340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:02:41.311340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:02:41.311340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:02:41.311340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:02:41.311340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a712db2a-4e2e-46b3-a696-9396ea8c5209 could not be found. May 25 15:02:41.311340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:41.311340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:41.311340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:41.311340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:41.311340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:41.311340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:41.311340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:02:41.311340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:02:41.311340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a712db2a-4e2e-46b3-a696-9396ea8c5209 could not be found. May 25 15:02:41.311340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:41.312443 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-28e4f062-afbb-4323-8fb5-699d7831f676 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Returning 404 to user: Instance a712db2a-4e2e-46b3-a696-9396ea8c5209 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:02:41.312443 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-28e4f062-afbb-4323-8fb5-699d7831f676 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 404 len: 111 microversion: 2.1 time: 0.036186 May 25 15:02:41.312443 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 311/608] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:41 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:02:41.421283 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-759cd8b5-25e8-45d0-a732-a29d5a864edc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1459095288", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1398894099", "security_groups": [{"name": "tempest-secgroup-smoke-1278455577"}], "block_device_mapping_v2": [{"uuid": "02ec8157-ae77-452b-8f89-3383d1bbb3ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "620eaca4-828c-4c2d-a756-ed68aa31fbcf"}]}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:41.480413 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-e9c37a10-daa4-4056-977a-cafbac7d297b req-f47796d0-a96c-4a91-9195-3c973d12d1ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2553a433-8b4b-4f36-b319-50c84e8b3d7c", "name": "network-vif-deleted", "tag": "21ecf2eb-2386-4559-afdf-cee34a7a8d0c"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:41.490768 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-e9c37a10-daa4-4056-977a-cafbac7d297b req-f47796d0-a96c-4a91-9195-3c973d12d1ba service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:41.491296 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-e9c37a10-daa4-4056-977a-cafbac7d297b req-f47796d0-a96c-4a91-9195-3c973d12d1ba service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:41.506555 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-e9c37a10-daa4-4056-977a-cafbac7d297b req-f47796d0-a96c-4a91-9195-3c973d12d1ba service nova] Creating event network-vif-deleted:21ecf2eb-2386-4559-afdf-cee34a7a8d0c for instance 2553a433-8b4b-4f36-b319-50c84e8b3d7c on hv-cinder-80382 May 25 15:02:41.513029 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-e9c37a10-daa4-4056-977a-cafbac7d297b req-f47796d0-a96c-4a91-9195-3c973d12d1ba service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041317 May 25 15:02:41.513880 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 312/609] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:41.554754 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.network.neutron [None req-759cd8b5-25e8-45d0-a732-a29d5a864edc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] validate_networks() for [('620eaca4-828c-4c2d-a756-ed68aa31fbcf', None, None, None, None, None)] {{(pid=124524) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:02:41.946538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-759cd8b5-25e8-45d0-a732-a29d5a864edc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Flavor limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:02:41.946964 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-759cd8b5-25e8-45d0-a732-a29d5a864edc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Image limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:02:41.947438 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-759cd8b5-25e8-45d0-a732-a29d5a864edc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Flavor pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:02:41.947847 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-759cd8b5-25e8-45d0-a732-a29d5a864edc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Image pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:02:41.948262 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-759cd8b5-25e8-45d0-a732-a29d5a864edc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:02:41.957442 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-759cd8b5-25e8-45d0-a732-a29d5a864edc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:41.957894 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-759cd8b5-25e8-45d0-a732-a29d5a864edc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:41.958734 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-759cd8b5-25e8-45d0-a732-a29d5a864edc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:41.959177 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-759cd8b5-25e8-45d0-a732-a29d5a864edc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:41.960859 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-903e7a3d-b9d3-4aed-9fe6-ff7fffb0660d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:41.961581 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-903e7a3d-b9d3-4aed-9fe6-ff7fffb0660d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:41.968226 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-903e7a3d-b9d3-4aed-9fe6-ff7fffb0660d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:41.968682 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-903e7a3d-b9d3-4aed-9fe6-ff7fffb0660d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:41.969457 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-903e7a3d-b9d3-4aed-9fe6-ff7fffb0660d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:41.969906 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-903e7a3d-b9d3-4aed-9fe6-ff7fffb0660d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:41.976877 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-759cd8b5-25e8-45d0-a732-a29d5a864edc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Getting quotas for project 99281bdc8f6340a1be03774c255ae4ba. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:02:41.981635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-759cd8b5-25e8-45d0-a732-a29d5a864edc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Getting quotas for user daec78050ee547699910603eff8cb7ca and project 99281bdc8f6340a1be03774c255ae4ba. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:02:42.002208 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-903e7a3d-b9d3-4aed-9fe6-ff7fffb0660d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:42.002745 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-903e7a3d-b9d3-4aed-9fe6-ff7fffb0660d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:42.003117 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.objects.instance [None req-903e7a3d-b9d3-4aed-9fe6-ff7fffb0660d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lazy-loading 'fault' on Instance uuid 2553a433-8b4b-4f36-b319-50c84e8b3d7c {{(pid=124523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:02:42.044266 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-759cd8b5-25e8-45d0-a732-a29d5a864edc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Going to run 1 instances... {{(pid=124524) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:02:42.046388 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-759cd8b5-25e8-45d0-a732-a29d5a864edc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='02ec8157-ae77-452b-8f89-3383d1bbb3ee',volume_size=None,volume_type=None)] {{(pid=124524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:02:42.048040 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-903e7a3d-b9d3-4aed-9fe6-ff7fffb0660d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97011bf8f6d444468fecdde7acfa1020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd27057280d4bdda5b9a689a1e399ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:42.056742 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-903e7a3d-b9d3-4aed-9fe6-ff7fffb0660d tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 200 len: 1312 microversion: 2.1 time: 0.099720 May 25 15:02:42.056742 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 313/610] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:41 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:02:42.062971 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-668a7ed7-d3c3-4836-9356-832f342b77c7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:42.064124 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-668a7ed7-d3c3-4836-9356-832f342b77c7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:42.070839 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-668a7ed7-d3c3-4836-9356-832f342b77c7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:42.071383 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-668a7ed7-d3c3-4836-9356-832f342b77c7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:42.072453 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-668a7ed7-d3c3-4836-9356-832f342b77c7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:42.072903 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-668a7ed7-d3c3-4836-9356-832f342b77c7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:42.114951 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-668a7ed7-d3c3-4836-9356-832f342b77c7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056908 May 25 15:02:42.116282 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 314/611] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:02:42 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:02:42.175996 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ed31cb5a-3936-4650-aa07-52564e16f31c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:42.176829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ed31cb5a-3936-4650-aa07-52564e16f31c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:42.183989 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ed31cb5a-3936-4650-aa07-52564e16f31c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:42.184688 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ed31cb5a-3936-4650-aa07-52564e16f31c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:42.185661 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ed31cb5a-3936-4650-aa07-52564e16f31c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:42.186311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ed31cb5a-3936-4650-aa07-52564e16f31c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:42.205638 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-759cd8b5-25e8-45d0-a732-a29d5a864edc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.788297 May 25 15:02:42.207255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 298/612] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 15:02:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:02:42.215601 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ed31cb5a-3936-4650-aa07-52564e16f31c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Going to try to terminate instance {{(pid=124523) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:02:42.218683 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-afea3814-42fa-48c6-a2da-1e6b65a368fb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:42.219292 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-afea3814-42fa-48c6-a2da-1e6b65a368fb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:42.280591 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-afea3814-42fa-48c6-a2da-1e6b65a368fb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:42.281467 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:42.288197 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-afea3814-42fa-48c6-a2da-1e6b65a368fb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1095 microversion: 2.1 time: 0.074503 May 25 15:02:42.289070 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 299/613] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:42 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:42.318458 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ed31cb5a-3936-4650-aa07-52564e16f31c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 204 len: 0 microversion: 2.1 time: 0.145351 May 25 15:02:42.322061 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 315/614] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:02:42 2022] DELETE /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 15:02:42.327832 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-5e70b286-e509-444e-bbbf-f778c9ad2068 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:42.328666 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-5e70b286-e509-444e-bbbf-f778c9ad2068 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:42.335430 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5e70b286-e509-444e-bbbf-f778c9ad2068 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:42.335919 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5e70b286-e509-444e-bbbf-f778c9ad2068 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:42.336779 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5e70b286-e509-444e-bbbf-f778c9ad2068 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:42.337209 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5e70b286-e509-444e-bbbf-f778c9ad2068 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:42.476786 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-5e70b286-e509-444e-bbbf-f778c9ad2068 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:42.485310 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-5e70b286-e509-444e-bbbf-f778c9ad2068 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 200 len: 1681 microversion: 2.1 time: 0.161406 May 25 15:02:42.485885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 300/615] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:42 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:43.074410 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-455d8e3e-86aa-4fc2-8767-9e1e5e827635 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:43.075113 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-455d8e3e-86aa-4fc2-8767-9e1e5e827635 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] [instance: 2553a433-8b4b-4f36-b319-50c84e8b3d7c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:43.081846 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-455d8e3e-86aa-4fc2-8767-9e1e5e827635 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:43.082333 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-455d8e3e-86aa-4fc2-8767-9e1e5e827635 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:43.083116 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-455d8e3e-86aa-4fc2-8767-9e1e5e827635 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:43.083558 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-455d8e3e-86aa-4fc2-8767-9e1e5e827635 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:43.099216 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-455d8e3e-86aa-4fc2-8767-9e1e5e827635 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] HTTP exception thrown: Instance 2553a433-8b4b-4f36-b319-50c84e8b3d7c could not be found. May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-455d8e3e-86aa-4fc2-8767-9e1e5e827635 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Request method failure captured: May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c HTTP/1.1 May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkOQmzSr_Z_HaubRx-8K0J1aivmzZNuHz2evwqGBpOEbVW_8T5qrSA5J06do9eAUOA11aw7skoO4YnbInUibqk41nPye7EGvIZtAObWYp0uJQiTEIBAVIL8lmFYJs7jq459Lvk6nm7QXpTp2CW9MWVgJbxByPFp56Fy8X_ZzDq-0ZWA May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: acd27057280d4bdda5b9a689a1e399ff May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1162490831 May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:02:43.100878 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:02:43.102515 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_acd27057280d4bdda5b9a689a1e399ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/acd27057280d4bdda5b9a689a1e399ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/acd27057280d4bdda5b9a689a1e399ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/acd27057280d4bdda5b9a689a1e399ff"}]}] May 25 15:02:43.102515 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1162490831 May 25 15:02:43.102515 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: acd27057280d4bdda5b9a689a1e399ff May 25 15:02:43.102515 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1162490831 May 25 15:02:43.102515 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-ServerRescueNegativeTestJSON-1162490831-project May 25 15:02:43.102515 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:02:43.102515 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:02:43.102515 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: 97011bf8f6d444468fecdde7acfa1020 May 25 15:02:43.102515 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1162490831-project May 25 15:02:43.102515 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:02:43.102515 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance 2553a433-8b4b-4f36-b319-50c84e8b3d7c could not be found. May 25 15:02:43.102515 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': '2553a433-8b4b-4f36-b319-50c84e8b3d7c'} May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2553a433-8b4b-4f36-b319-50c84e8b3d7c could not be found. May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:02:43.103739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:02:43.105782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:02:43.105782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:02:43.105782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:02:43.105782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:02:43.105782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:02:43.105782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:02:43.105782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:02:43.105782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2553a433-8b4b-4f36-b319-50c84e8b3d7c could not be found. May 25 15:02:43.105782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:43.105782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:43.105782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:43.105782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:43.105782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:43.105782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:43.105782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:02:43.105782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:02:43.105782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2553a433-8b4b-4f36-b319-50c84e8b3d7c could not be found. May 25 15:02:43.105782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:43.107209 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-455d8e3e-86aa-4fc2-8767-9e1e5e827635 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] Returning 404 to user: Instance 2553a433-8b4b-4f36-b319-50c84e8b3d7c could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:02:43.107209 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-455d8e3e-86aa-4fc2-8767-9e1e5e827635 tempest-ServerRescueNegativeTestJSON-1162490831 tempest-ServerRescueNegativeTestJSON-1162490831-project] 10.222.0.78 "GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c" status: 404 len: 111 microversion: 2.1 time: 0.032158 May 25 15:02:43.107209 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 316/616] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:43 2022] GET /compute/v2.1/servers/2553a433-8b4b-4f36-b319-50c84e8b3d7c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:02:43.305750 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a38e0250-a423-4eb4-ba9a-20c1630d27c6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:43.306598 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-a38e0250-a423-4eb4-ba9a-20c1630d27c6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:43.318123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a38e0250-a423-4eb4-ba9a-20c1630d27c6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:43.318574 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a38e0250-a423-4eb4-ba9a-20c1630d27c6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:43.319367 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a38e0250-a423-4eb4-ba9a-20c1630d27c6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:43.319811 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a38e0250-a423-4eb4-ba9a-20c1630d27c6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:43.383678 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-a38e0250-a423-4eb4-ba9a-20c1630d27c6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:43.392657 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-a38e0250-a423-4eb4-ba9a-20c1630d27c6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1145 microversion: 2.1 time: 0.090597 May 25 15:02:43.393390 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 301/617] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:43 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:43.503908 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-246efb98-a299-41df-8de9-ab2a09a2d51f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:43.504586 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-246efb98-a299-41df-8de9-ab2a09a2d51f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:43.511898 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-246efb98-a299-41df-8de9-ab2a09a2d51f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:43.512351 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-246efb98-a299-41df-8de9-ab2a09a2d51f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:43.513139 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-246efb98-a299-41df-8de9-ab2a09a2d51f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:43.513582 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-246efb98-a299-41df-8de9-ab2a09a2d51f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:43.724742 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-246efb98-a299-41df-8de9-ab2a09a2d51f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:43.732345 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-246efb98-a299-41df-8de9-ab2a09a2d51f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 200 len: 1681 microversion: 2.1 time: 0.232516 May 25 15:02:43.732910 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 317/618] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:43 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:44.410877 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-ad4f5a3d-c8ba-4230-90d4-bd933df23c8a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:44.411466 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-ad4f5a3d-c8ba-4230-90d4-bd933df23c8a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:44.419083 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ad4f5a3d-c8ba-4230-90d4-bd933df23c8a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:44.419310 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ad4f5a3d-c8ba-4230-90d4-bd933df23c8a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:44.419928 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ad4f5a3d-c8ba-4230-90d4-bd933df23c8a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:44.420345 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ad4f5a3d-c8ba-4230-90d4-bd933df23c8a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:44.490448 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-ad4f5a3d-c8ba-4230-90d4-bd933df23c8a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:44.500839 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-ad4f5a3d-c8ba-4230-90d4-bd933df23c8a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1137 microversion: 2.1 time: 0.093545 May 25 15:02:44.502114 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 302/619] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:44 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1137 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:44.749190 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b1945cb6-b271-4601-a09b-3bfa1b937805 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:44.749890 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-b1945cb6-b271-4601-a09b-3bfa1b937805 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:44.756053 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b1945cb6-b271-4601-a09b-3bfa1b937805 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:44.756502 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b1945cb6-b271-4601-a09b-3bfa1b937805 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:44.757273 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b1945cb6-b271-4601-a09b-3bfa1b937805 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:44.757978 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b1945cb6-b271-4601-a09b-3bfa1b937805 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:44.979643 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-b1945cb6-b271-4601-a09b-3bfa1b937805 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:44.988044 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-b1945cb6-b271-4601-a09b-3bfa1b937805 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 200 len: 1681 microversion: 2.1 time: 0.243181 May 25 15:02:44.988859 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 318/620] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:44 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 1681 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:45.522589 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-92853114-a8e8-47e8-81a4-cf1731ca6204 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:45.524187 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-92853114-a8e8-47e8-81a4-cf1731ca6204 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:45.535894 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-92853114-a8e8-47e8-81a4-cf1731ca6204 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:45.537115 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-92853114-a8e8-47e8-81a4-cf1731ca6204 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:45.538789 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-92853114-a8e8-47e8-81a4-cf1731ca6204 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:45.539876 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-92853114-a8e8-47e8-81a4-cf1731ca6204 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:45.686842 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-92853114-a8e8-47e8-81a4-cf1731ca6204 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:45.703046 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-92853114-a8e8-47e8-81a4-cf1731ca6204 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1211 microversion: 2.1 time: 0.185704 May 25 15:02:45.723106 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 303/621] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:45 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1211 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:46.008399 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d488fd2b-aee9-4962-8c8d-f61febd06264 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:46.010182 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d488fd2b-aee9-4962-8c8d-f61febd06264 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:46.021100 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d488fd2b-aee9-4962-8c8d-f61febd06264 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:46.022091 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d488fd2b-aee9-4962-8c8d-f61febd06264 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:46.023733 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d488fd2b-aee9-4962-8c8d-f61febd06264 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:46.024882 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d488fd2b-aee9-4962-8c8d-f61febd06264 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:46.165681 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d488fd2b-aee9-4962-8c8d-f61febd06264 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:46.176233 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d488fd2b-aee9-4962-8c8d-f61febd06264 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 200 len: 1614 microversion: 2.1 time: 0.173700 May 25 15:02:46.185440 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 319/622] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:46 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 1614 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:46.420906 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-cc09dffb-0197-4b4e-9dfc-c6d8ffda0058 req-fa1475d6-8301-40a5-b871-a4258338ad2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd834bb-ffdb-40c9-9585-cb81a52a3322", "name": "network-vif-deleted", "tag": "f723a574-6986-4689-9b35-12c406a41e8e"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:46.453682 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-cc09dffb-0197-4b4e-9dfc-c6d8ffda0058 req-fa1475d6-8301-40a5-b871-a4258338ad2b service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:46.454691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-cc09dffb-0197-4b4e-9dfc-c6d8ffda0058 req-fa1475d6-8301-40a5-b871-a4258338ad2b service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:46.477571 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-cc09dffb-0197-4b4e-9dfc-c6d8ffda0058 req-fa1475d6-8301-40a5-b871-a4258338ad2b service nova] Creating event network-vif-deleted:f723a574-6986-4689-9b35-12c406a41e8e for instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 on hv-cinder-80382 May 25 15:02:46.493052 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-cc09dffb-0197-4b4e-9dfc-c6d8ffda0058 req-fa1475d6-8301-40a5-b871-a4258338ad2b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074723 May 25 15:02:46.496720 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 304/623] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:46.728535 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b0dae744-6e26-4b54-915f-c7f6eef2a565 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:46.729499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-b0dae744-6e26-4b54-915f-c7f6eef2a565 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:46.737849 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b0dae744-6e26-4b54-915f-c7f6eef2a565 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:46.738463 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b0dae744-6e26-4b54-915f-c7f6eef2a565 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:46.739249 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b0dae744-6e26-4b54-915f-c7f6eef2a565 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:46.739803 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b0dae744-6e26-4b54-915f-c7f6eef2a565 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:47.147735 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-b0dae744-6e26-4b54-915f-c7f6eef2a565 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:47.156706 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-b0dae744-6e26-4b54-915f-c7f6eef2a565 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1267 microversion: 2.1 time: 0.432436 May 25 15:02:47.158398 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 320/624] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:46 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1267 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:02:47.205842 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-07344985-b5f0-4311-97ab-f30f3884edd3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:47.207483 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-07344985-b5f0-4311-97ab-f30f3884edd3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:47.230986 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-07344985-b5f0-4311-97ab-f30f3884edd3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:47.232867 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-07344985-b5f0-4311-97ab-f30f3884edd3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:47.236310 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-07344985-b5f0-4311-97ab-f30f3884edd3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:47.237796 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-07344985-b5f0-4311-97ab-f30f3884edd3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:47.335539 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-07344985-b5f0-4311-97ab-f30f3884edd3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:47.335911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-07344985-b5f0-4311-97ab-f30f3884edd3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:47.336923 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-07344985-b5f0-4311-97ab-f30f3884edd3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lazy-loading 'fault' on Instance uuid 0cd834bb-ffdb-40c9-9585-cb81a52a3322 {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:02:47.419263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-07344985-b5f0-4311-97ab-f30f3884edd3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:47.427788 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-07344985-b5f0-4311-97ab-f30f3884edd3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 200 len: 1330 microversion: 2.1 time: 0.228334 May 25 15:02:47.429152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 305/625] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:47 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 1330 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:47.528014 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-f183aad4-dc25-450c-8a84-1cca0b9a6023 req-db84c4f1-f820-46f5-a820-b4d92c57ea67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62cd86f-b289-4006-bd52-2dad10b43e93", "tag": "fd6e6b51-3ed9-43c2-8f3a-8d7ad380c206"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:47.556960 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-f183aad4-dc25-450c-8a84-1cca0b9a6023 req-db84c4f1-f820-46f5-a820-b4d92c57ea67 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:47.558296 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-f183aad4-dc25-450c-8a84-1cca0b9a6023 req-db84c4f1-f820-46f5-a820-b4d92c57ea67 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:47.575974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-f183aad4-dc25-450c-8a84-1cca0b9a6023 req-db84c4f1-f820-46f5-a820-b4d92c57ea67 service nova] Creating event network-changed:fd6e6b51-3ed9-43c2-8f3a-8d7ad380c206 for instance d62cd86f-b289-4006-bd52-2dad10b43e93 on hv-cinder-80382 May 25 15:02:47.588066 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-f183aad4-dc25-450c-8a84-1cca0b9a6023 req-db84c4f1-f820-46f5-a820-b4d92c57ea67 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063999 May 25 15:02:47.589419 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 321/626] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:02:48.181019 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7e21b203-391c-4497-81ca-7a844d5b1895 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:48.182088 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7e21b203-391c-4497-81ca-7a844d5b1895 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:48.190891 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7e21b203-391c-4497-81ca-7a844d5b1895 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:48.191444 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7e21b203-391c-4497-81ca-7a844d5b1895 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:48.192264 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7e21b203-391c-4497-81ca-7a844d5b1895 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:48.192864 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7e21b203-391c-4497-81ca-7a844d5b1895 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:48.439508 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7e21b203-391c-4497-81ca-7a844d5b1895 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:48.449199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4241b67b-f63b-4db4-8c66-fb2efd2ed001 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:48.450516 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4241b67b-f63b-4db4-8c66-fb2efd2ed001 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:48.457055 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7e21b203-391c-4497-81ca-7a844d5b1895 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1267 microversion: 2.1 time: 0.284399 May 25 15:02:48.458028 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4241b67b-f63b-4db4-8c66-fb2efd2ed001 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:48.458540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4241b67b-f63b-4db4-8c66-fb2efd2ed001 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:48.459316 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4241b67b-f63b-4db4-8c66-fb2efd2ed001 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:48.459985 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4241b67b-f63b-4db4-8c66-fb2efd2ed001 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:48.470686 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 306/627] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:48 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1267 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:48.481346 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-4241b67b-f63b-4db4-8c66-fb2efd2ed001 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] HTTP exception thrown: Instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 could not be found. May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4241b67b-f63b-4db4-8c66-fb2efd2ed001 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Request method failure captured: May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 HTTP/1.1 May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkOaNMspd4aouSbU1AbWPRZXQpnMIXaZVnqXM_GcJU5QANUYoykKOboFENZqE39ayR7YV98XzJEhmbNMT4xGE2Rmi1LhcZy3xlCFBJXF3aSJNrYEmDnN6WznzrHbbYABEJ1DEPcIqWV1-In6s7XLRv6-66f2Fc-5c9Wz9_np-VTpkmg May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:02:48.493714 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:02:48.495608 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}] May 25 15:02:48.495608 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-AttachVolumeNegativeTest-533430010 May 25 15:02:48.495608 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:02:48.495608 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:02:48.495608 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:02:48.495608 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:02:48.495608 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:02:48.495608 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: e60a5e751f22450c8e366c85b37af1f6 May 25 15:02:48.495608 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:02:48.495608 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:02:48.495608 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 could not be found. May 25 15:02:48.495608 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': '0cd834bb-ffdb-40c9-9585-cb81a52a3322'} May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 could not be found. May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:02:48.496905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:02:48.499231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:02:48.499231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:02:48.499231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:02:48.499231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:02:48.499231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:02:48.499231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:02:48.499231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:02:48.499231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 could not be found. May 25 15:02:48.499231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:48.499231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:48.499231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:48.499231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:48.499231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:48.499231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:48.499231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:02:48.499231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:02:48.499231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 could not be found. May 25 15:02:48.499231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:02:48.501748 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4241b67b-f63b-4db4-8c66-fb2efd2ed001 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Returning 404 to user: Instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:02:48.501748 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4241b67b-f63b-4db4-8c66-fb2efd2ed001 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 404 len: 111 microversion: 2.1 time: 0.051881 May 25 15:02:48.501748 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 322/628] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:48 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:02:48.510436 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-956c729d-3094-441a-8b55-5f5889a7ab84 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '.version_select at 0x7fb1daed8820>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:48.533134 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-956c729d-3094-441a-8b55-5f5889a7ab84 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-661729123" status: 202 len: 0 microversion: 2.1 time: 0.027480 May 25 15:02:48.534133 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 307/629] 10.222.0.78 () {58 vars in 1217 bytes} [Wed May 25 15:02:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-661729123 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:02:49.382062 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-9979cbab-5ea9-4422-8526-c7e3c2b669a5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Action: 'create', calling method: .version_select at 0x7fb1da788b80>, body: {"keypair": {"name": "tempest-keypair-76811187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWUHpfzjL+yvWB7qS+CAZUxfLinkeb30If+Xhenx2KN+CJxCmOhl1TpfJTRkKD6QVUWMKAY/gl870gF1APIll9cbzsPBB4ncAMM3t2QmnaJBqd2Twc37MvR+pkvvYBlpA=="}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:49.388405 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:49.400489 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-9979cbab-5ea9-4422-8526-c7e3c2b669a5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Getting quotas for project 9dafcd0df8524413b4fe81a0931323b1. Resources: {'key_pairs'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:02:49.406471 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-9979cbab-5ea9-4422-8526-c7e3c2b669a5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Getting quotas for user e60a5e751f22450c8e366c85b37af1f6 and project 9dafcd0df8524413b4fe81a0931323b1. Resources: {'key_pairs'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:02:49.432522 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-9979cbab-5ea9-4422-8526-c7e3c2b669a5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.054193 May 25 15:02:49.433235 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 323/630] 10.222.0.78 () {60 vars in 1158 bytes} [Wed May 25 15:02:49 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:49.484614 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7ad3a398-f22e-40ee-a8f3-8d3fe1a4e43e tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:49.485391 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7ad3a398-f22e-40ee-a8f3-8d3fe1a4e43e tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:49.488645 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:49.493347 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7ad3a398-f22e-40ee-a8f3-8d3fe1a4e43e tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:49.493799 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7ad3a398-f22e-40ee-a8f3-8d3fe1a4e43e tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:49.494816 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7ad3a398-f22e-40ee-a8f3-8d3fe1a4e43e tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:49.495370 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7ad3a398-f22e-40ee-a8f3-8d3fe1a4e43e tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:49.705248 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7ad3a398-f22e-40ee-a8f3-8d3fe1a4e43e tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:49.713603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7ad3a398-f22e-40ee-a8f3-8d3fe1a4e43e tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1267 microversion: 2.1 time: 0.233596 May 25 15:02:49.715600 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 308/631] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:49 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:50.736845 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-840b1f8d-eb9a-4e21-9c00-37f88db5896d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:50.738989 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-840b1f8d-eb9a-4e21-9c00-37f88db5896d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:50.749931 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-840b1f8d-eb9a-4e21-9c00-37f88db5896d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:50.750193 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-840b1f8d-eb9a-4e21-9c00-37f88db5896d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:50.751164 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-840b1f8d-eb9a-4e21-9c00-37f88db5896d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:50.751600 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-840b1f8d-eb9a-4e21-9c00-37f88db5896d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:50.953333 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-840b1f8d-eb9a-4e21-9c00-37f88db5896d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:50.967356 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-840b1f8d-eb9a-4e21-9c00-37f88db5896d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1267 microversion: 2.1 time: 0.239305 May 25 15:02:50.977502 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 324/632] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:50 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1267 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:50.979357 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0cd58f11-e9ca-4b45-bb33-a06d3b797a73 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-35310032", "imageRef": "fbec7c78-0103-4632-9a21-d8e8056f2ce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c4b07fe-140a-4a0b-9f8f-030d2bf81125"}], "security_groups": [{"name": "tempest-securitygroup--1702726512"}], "key_name": "tempest-keypair-76811187", "user_data": "}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:51.167709 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.network.neutron [None req-0cd58f11-e9ca-4b45-bb33-a06d3b797a73 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] validate_networks() for [('6c4b07fe-140a-4a0b-9f8f-030d2bf81125', None, None, None, None, None)] {{(pid=124524) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:02:51.898889 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-0cd58f11-e9ca-4b45-bb33-a06d3b797a73 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Flavor limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:02:51.899512 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-0cd58f11-e9ca-4b45-bb33-a06d3b797a73 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Image limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:02:51.900152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-0cd58f11-e9ca-4b45-bb33-a06d3b797a73 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Flavor pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:02:51.900722 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-0cd58f11-e9ca-4b45-bb33-a06d3b797a73 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Image pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:02:51.901689 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-0cd58f11-e9ca-4b45-bb33-a06d3b797a73 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:02:51.912886 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0cd58f11-e9ca-4b45-bb33-a06d3b797a73 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:51.913374 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0cd58f11-e9ca-4b45-bb33-a06d3b797a73 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:51.914468 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0cd58f11-e9ca-4b45-bb33-a06d3b797a73 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:51.915204 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0cd58f11-e9ca-4b45-bb33-a06d3b797a73 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:51.934675 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-0cd58f11-e9ca-4b45-bb33-a06d3b797a73 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Getting quotas for project 9dafcd0df8524413b4fe81a0931323b1. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:02:51.939032 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-0cd58f11-e9ca-4b45-bb33-a06d3b797a73 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Getting quotas for user e60a5e751f22450c8e366c85b37af1f6 and project 9dafcd0df8524413b4fe81a0931323b1. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:02:51.951114 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0cd58f11-e9ca-4b45-bb33-a06d3b797a73 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Going to run 1 instances... {{(pid=124524) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:02:51.953447 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0cd58f11-e9ca-4b45-bb33-a06d3b797a73 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbec7c78-0103-4632-9a21-d8e8056f2ce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:02:51.987484 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-533c1a04-f45d-4950-88ef-0b9a32aa658e tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:51.988209 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-533c1a04-f45d-4950-88ef-0b9a32aa658e tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:51.996424 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-533c1a04-f45d-4950-88ef-0b9a32aa658e tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:51.997167 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-533c1a04-f45d-4950-88ef-0b9a32aa658e tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:51.997970 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-533c1a04-f45d-4950-88ef-0b9a32aa658e tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:51.998456 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-533c1a04-f45d-4950-88ef-0b9a32aa658e tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:52.012051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0cd58f11-e9ca-4b45-bb33-a06d3b797a73 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.038152 May 25 15:02:52.013652 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 309/633] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 15:02:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 15:02:52.026244 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6b28b38f-b4b6-4591-a615-169ffc9c3f7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:52.027867 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6b28b38f-b4b6-4591-a615-169ffc9c3f7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:52.135000 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6b28b38f-b4b6-4591-a615-169ffc9c3f7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:52.145777 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6b28b38f-b4b6-4591-a615-169ffc9c3f7b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 200 len: 1238 microversion: 2.1 time: 0.125374 May 25 15:02:52.152696 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 310/634] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:52 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 1238 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:52.216784 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-533c1a04-f45d-4950-88ef-0b9a32aa658e tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:52.227277 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-533c1a04-f45d-4950-88ef-0b9a32aa658e tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1267 microversion: 2.1 time: 0.245292 May 25 15:02:52.228314 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 325/635] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:51 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:02:53.168918 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8ef0314c-f849-47f3-9cd9-a1e5ae0e0c78 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:53.169776 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-8ef0314c-f849-47f3-9cd9-a1e5ae0e0c78 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:53.187689 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8ef0314c-f849-47f3-9cd9-a1e5ae0e0c78 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:53.191120 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8ef0314c-f849-47f3-9cd9-a1e5ae0e0c78 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:53.195035 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8ef0314c-f849-47f3-9cd9-a1e5ae0e0c78 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:53.195818 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8ef0314c-f849-47f3-9cd9-a1e5ae0e0c78 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:53.245792 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-457b7429-ae48-499a-a21d-eb97af0f141d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:53.246647 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-457b7429-ae48-499a-a21d-eb97af0f141d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:53.265787 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-457b7429-ae48-499a-a21d-eb97af0f141d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:53.274231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-457b7429-ae48-499a-a21d-eb97af0f141d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:53.275673 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-457b7429-ae48-499a-a21d-eb97af0f141d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:53.276389 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-457b7429-ae48-499a-a21d-eb97af0f141d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:53.386294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-8ef0314c-f849-47f3-9cd9-a1e5ae0e0c78 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:53.400655 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-8ef0314c-f849-47f3-9cd9-a1e5ae0e0c78 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 200 len: 1290 microversion: 2.1 time: 0.240427 May 25 15:02:53.412556 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 311/636] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:53 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 1290 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:53.620488 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-457b7429-ae48-499a-a21d-eb97af0f141d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:53.628460 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-457b7429-ae48-499a-a21d-eb97af0f141d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1267 microversion: 2.1 time: 0.387322 May 25 15:02:53.629633 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 326/637] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:53 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1267 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:02:54.421558 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-c4ffb26e-ab46-40b8-b690-140f26cc22f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:54.423670 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-c4ffb26e-ab46-40b8-b690-140f26cc22f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:54.435789 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c4ffb26e-ab46-40b8-b690-140f26cc22f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:54.437220 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c4ffb26e-ab46-40b8-b690-140f26cc22f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:54.438283 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c4ffb26e-ab46-40b8-b690-140f26cc22f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:54.440105 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c4ffb26e-ab46-40b8-b690-140f26cc22f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:54.534531 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-c4ffb26e-ab46-40b8-b690-140f26cc22f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:54.544088 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-c4ffb26e-ab46-40b8-b690-140f26cc22f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 200 len: 1296 microversion: 2.1 time: 0.128638 May 25 15:02:54.555234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 312/638] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:54 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 1296 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:54.646410 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d704bdbd-07e2-4636-9464-cdfdf0bc669f tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:54.647678 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d704bdbd-07e2-4636-9464-cdfdf0bc669f tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:54.661617 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d704bdbd-07e2-4636-9464-cdfdf0bc669f tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:54.662326 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d704bdbd-07e2-4636-9464-cdfdf0bc669f tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:54.663332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d704bdbd-07e2-4636-9464-cdfdf0bc669f tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:54.663931 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d704bdbd-07e2-4636-9464-cdfdf0bc669f tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:55.104192 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d704bdbd-07e2-4636-9464-cdfdf0bc669f tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:55.116676 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d704bdbd-07e2-4636-9464-cdfdf0bc669f tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1267 microversion: 2.1 time: 0.474127 May 25 15:02:55.117576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 327/639] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:54 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1267 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:55.562082 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b5eda7b1-65ed-470e-9f0c-bf6622dc76f7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:55.562900 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b5eda7b1-65ed-470e-9f0c-bf6622dc76f7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:55.570212 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b5eda7b1-65ed-470e-9f0c-bf6622dc76f7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:55.571591 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b5eda7b1-65ed-470e-9f0c-bf6622dc76f7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:55.572667 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b5eda7b1-65ed-470e-9f0c-bf6622dc76f7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:55.573809 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b5eda7b1-65ed-470e-9f0c-bf6622dc76f7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:55.590670 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=100 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:55.721589 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b5eda7b1-65ed-470e-9f0c-bf6622dc76f7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:55.729850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b5eda7b1-65ed-470e-9f0c-bf6622dc76f7 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 200 len: 1364 microversion: 2.1 time: 0.171409 May 25 15:02:55.730744 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 313/640] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:55 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:56.141768 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8c5d53c1-a014-4497-ad0d-e581458d8811 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:56.143266 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8c5d53c1-a014-4497-ad0d-e581458d8811 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:56.157903 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8c5d53c1-a014-4497-ad0d-e581458d8811 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:56.158983 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8c5d53c1-a014-4497-ad0d-e581458d8811 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:56.160331 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8c5d53c1-a014-4497-ad0d-e581458d8811 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:56.160847 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8c5d53c1-a014-4497-ad0d-e581458d8811 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:56.446310 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-e1bab976-5b68-4f11-860b-fd6fe0c65f71 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Action: 'create', calling method: .version_select at 0x7fb1db767550>, body: {"keypair": {"name": "tempest-keypair-1262597987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7ZcP3MK6OnI3b7jQrKuZ4uh497ylIgXWB+im8AogMTvo5KDQAlLrwr+bbO/p3ecs8Ls00dNeVd0HCgKc0yyJbVZfzaL18nVbfEjht0y1T41bcG1TXA5BElXmhHiban+g=="}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:56.447104 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8c5d53c1-a014-4497-ad0d-e581458d8811 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:56.455023 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8c5d53c1-a014-4497-ad0d-e581458d8811 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1267 microversion: 2.1 time: 0.317863 May 25 15:02:56.456200 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 328/641] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:56 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1267 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:56.467139 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-e1bab976-5b68-4f11-860b-fd6fe0c65f71 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Getting quotas for project 2b586a13e82f4177a7180f81acf675fd. Resources: {'key_pairs'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:02:56.474282 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-e1bab976-5b68-4f11-860b-fd6fe0c65f71 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Getting quotas for user 34b1591b0eb944ed98c42d35a03c1ff9 and project 2b586a13e82f4177a7180f81acf675fd. Resources: {'key_pairs'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:02:56.514503 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-e1bab976-5b68-4f11-860b-fd6fe0c65f71 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.215185 May 25 15:02:56.516834 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 314/642] 10.222.0.78 () {62 vars in 1199 bytes} [Wed May 25 15:02:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 217 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 25 15:02:56.747835 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-c618f760-2fb2-4a2e-9aaa-20c63023be38 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:56.748448 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-c618f760-2fb2-4a2e-9aaa-20c63023be38 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:56.759561 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c618f760-2fb2-4a2e-9aaa-20c63023be38 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:56.760017 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c618f760-2fb2-4a2e-9aaa-20c63023be38 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:56.760841 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c618f760-2fb2-4a2e-9aaa-20c63023be38 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:56.761309 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c618f760-2fb2-4a2e-9aaa-20c63023be38 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:56.992581 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1b6dbf0e-7891-4acc-b955-11296733717e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:56.993931 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1b6dbf0e-7891-4acc-b955-11296733717e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:57.001385 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1b6dbf0e-7891-4acc-b955-11296733717e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:57.001933 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1b6dbf0e-7891-4acc-b955-11296733717e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:57.003012 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1b6dbf0e-7891-4acc-b955-11296733717e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:57.003515 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1b6dbf0e-7891-4acc-b955-11296733717e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:57.040115 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1b6dbf0e-7891-4acc-b955-11296733717e tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/ips" status: 200 len: 144 microversion: 2.1 time: 0.052006 May 25 15:02:57.040807 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 315/643] 10.222.0.78 () {58 vars in 1247 bytes} [Wed May 25 15:02:56 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/ips => generated 144 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:57.122783 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-c618f760-2fb2-4a2e-9aaa-20c63023be38 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:57.135323 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-c618f760-2fb2-4a2e-9aaa-20c63023be38 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 200 len: 1364 microversion: 2.1 time: 0.391731 May 25 15:02:57.138195 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 329/644] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:56 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 1364 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:57.244526 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-06a7410c-4f83-4c0c-88a8-a7864a33f56a req-018879c7-84a8-4a01-a326-471b66af443e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d08c7580-ff9d-4f6a-894b-ec2805b4f883", "tag": "abb2be77-3e38-420c-873c-fc5389d260f3"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:57.280546 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-06a7410c-4f83-4c0c-88a8-a7864a33f56a req-018879c7-84a8-4a01-a326-471b66af443e service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:57.281400 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-06a7410c-4f83-4c0c-88a8-a7864a33f56a req-018879c7-84a8-4a01-a326-471b66af443e service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:57.303095 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-06a7410c-4f83-4c0c-88a8-a7864a33f56a req-018879c7-84a8-4a01-a326-471b66af443e service nova] Creating event network-changed:abb2be77-3e38-420c-873c-fc5389d260f3 for instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 on hv-cinder-80382 May 25 15:02:57.311347 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-06a7410c-4f83-4c0c-88a8-a7864a33f56a req-018879c7-84a8-4a01-a326-471b66af443e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076701 May 25 15:02:57.313549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 316/645] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:02:57.478538 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-16ceaee8-1b39-4596-b35e-f4529f5a1719 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:57.479149 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-16ceaee8-1b39-4596-b35e-f4529f5a1719 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:57.491619 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-16ceaee8-1b39-4596-b35e-f4529f5a1719 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:57.493502 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-16ceaee8-1b39-4596-b35e-f4529f5a1719 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:57.494661 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-16ceaee8-1b39-4596-b35e-f4529f5a1719 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:57.496108 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-16ceaee8-1b39-4596-b35e-f4529f5a1719 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:57.953264 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-16ceaee8-1b39-4596-b35e-f4529f5a1719 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:57.964498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-16ceaee8-1b39-4596-b35e-f4529f5a1719 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1267 microversion: 2.1 time: 0.495093 May 25 15:02:57.976174 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 330/646] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:57 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1267 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:58.169650 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d668ad0b-d101-4e60-a312-3d97e1e1bfd5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:58.171198 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d668ad0b-d101-4e60-a312-3d97e1e1bfd5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:58.190780 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d668ad0b-d101-4e60-a312-3d97e1e1bfd5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:58.192413 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d668ad0b-d101-4e60-a312-3d97e1e1bfd5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:58.193473 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d668ad0b-d101-4e60-a312-3d97e1e1bfd5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:58.194145 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d668ad0b-d101-4e60-a312-3d97e1e1bfd5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:58.477928 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d668ad0b-d101-4e60-a312-3d97e1e1bfd5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:58.486070 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d668ad0b-d101-4e60-a312-3d97e1e1bfd5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 200 len: 1364 microversion: 2.1 time: 0.324913 May 25 15:02:58.492115 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 317/647] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:58 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 1364 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:58.673080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4849a444-9297-4f55-8e99-d0b908ab3edd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c03c1ed9-0e46-4599-b422-b315ed122300"}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:58.673914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4849a444-9297-4f55-8e99-d0b908ab3edd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:58.682304 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4849a444-9297-4f55-8e99-d0b908ab3edd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:58.682937 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4849a444-9297-4f55-8e99-d0b908ab3edd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:58.684209 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4849a444-9297-4f55-8e99-d0b908ab3edd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:58.684620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4849a444-9297-4f55-8e99-d0b908ab3edd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:58.725806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-ac5795e3-d263-4207-9fe4-b3b897e1e39b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2032545603", "imageRef": "fbec7c78-0103-4632-9a21-d8e8056f2ce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6028651b-e908-45f7-9bba-a9ff244363d6"}], "security_groups": [{"name": "tempest-securitygroup--981175333"}], "key_name": "tempest-keypair-1262597987", "user_data": "}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:58.856110 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.network.neutron [None req-ac5795e3-d263-4207-9fe4-b3b897e1e39b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] validate_networks() for [('6028651b-e908-45f7-9bba-a9ff244363d6', None, None, None, None, None)] {{(pid=124524) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:02:59.384061 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-ac5795e3-d263-4207-9fe4-b3b897e1e39b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Flavor limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:02:59.385279 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-ac5795e3-d263-4207-9fe4-b3b897e1e39b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Image limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:02:59.386079 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-ac5795e3-d263-4207-9fe4-b3b897e1e39b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Flavor pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:02:59.387003 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-ac5795e3-d263-4207-9fe4-b3b897e1e39b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Image pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:02:59.387669 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-ac5795e3-d263-4207-9fe4-b3b897e1e39b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:02:59.400263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ac5795e3-d263-4207-9fe4-b3b897e1e39b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:59.400999 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ac5795e3-d263-4207-9fe4-b3b897e1e39b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:59.402252 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ac5795e3-d263-4207-9fe4-b3b897e1e39b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:59.402708 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ac5795e3-d263-4207-9fe4-b3b897e1e39b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:59.417620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=4 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:59.432292 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-ac5795e3-d263-4207-9fe4-b3b897e1e39b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Getting quotas for project 2b586a13e82f4177a7180f81acf675fd. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:02:59.438796 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-ac5795e3-d263-4207-9fe4-b3b897e1e39b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Getting quotas for user 34b1591b0eb944ed98c42d35a03c1ff9 and project 2b586a13e82f4177a7180f81acf675fd. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:02:59.452917 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-ac5795e3-d263-4207-9fe4-b3b897e1e39b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Going to run 1 instances... {{(pid=124524) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:02:59.455740 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-ac5795e3-d263-4207-9fe4-b3b897e1e39b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbec7c78-0103-4632-9a21-d8e8056f2ce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:02:59.518288 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-ac5795e3-d263-4207-9fe4-b3b897e1e39b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.797369 May 25 15:02:59.524541 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 318/648] 10.222.0.78 () {62 vars in 1187 bytes} [Wed May 25 15:02:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 25 15:02:59.531483 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4849a444-9297-4f55-8e99-d0b908ab3edd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "POST /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.862355 May 25 15:02:59.531701 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-466cac97-ac9e-40e2-a834-0567f3137e65 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:59.533036 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-466cac97-ac9e-40e2-a834-0567f3137e65 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:59.536393 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 331/649] 10.222.0.78 () {60 vars in 1322 bytes} [Wed May 25 15:02:58 2022] POST /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments => generated 194 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:59.545992 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-466cac97-ac9e-40e2-a834-0567f3137e65 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:59.546765 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-466cac97-ac9e-40e2-a834-0567f3137e65 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:59.548107 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-466cac97-ac9e-40e2-a834-0567f3137e65 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:59.549041 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-466cac97-ac9e-40e2-a834-0567f3137e65 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:59.553857 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-f1fcfa23-0989-4b3d-8701-7eeedd7efa55 req-2681e346-21d2-40d3-9fd1-b1755332dd86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62cd86f-b289-4006-bd52-2dad10b43e93", "name": "network-vif-plugged", "status": "completed", "tag": "fd6e6b51-3ed9-43c2-8f3a-8d7ad380c206"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:59.574383 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-f1fcfa23-0989-4b3d-8701-7eeedd7efa55 req-2681e346-21d2-40d3-9fd1-b1755332dd86 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:59.578285 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-f1fcfa23-0989-4b3d-8701-7eeedd7efa55 req-2681e346-21d2-40d3-9fd1-b1755332dd86 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:59.592924 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-f1fcfa23-0989-4b3d-8701-7eeedd7efa55 req-2681e346-21d2-40d3-9fd1-b1755332dd86 service nova] Creating event network-vif-plugged:fd6e6b51-3ed9-43c2-8f3a-8d7ad380c206 for instance d62cd86f-b289-4006-bd52-2dad10b43e93 on hv-cinder-80382 May 25 15:02:59.599451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-f1fcfa23-0989-4b3d-8701-7eeedd7efa55 req-2681e346-21d2-40d3-9fd1-b1755332dd86 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058976 May 25 15:02:59.600416 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 332/650] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:59.608700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-38c2cf2e-c820-4b62-873d-151ee1c67009 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:59.610183 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-38c2cf2e-c820-4b62-873d-151ee1c67009 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:59.618278 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-38c2cf2e-c820-4b62-873d-151ee1c67009 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:59.619119 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-38c2cf2e-c820-4b62-873d-151ee1c67009 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:59.620184 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-38c2cf2e-c820-4b62-873d-151ee1c67009 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:59.621450 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-38c2cf2e-c820-4b62-873d-151ee1c67009 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:59.921681 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-466cac97-ac9e-40e2-a834-0567f3137e65 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:59.934836 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-466cac97-ac9e-40e2-a834-0567f3137e65 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1267 microversion: 2.1 time: 0.412524 May 25 15:02:59.938987 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 319/651] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:59 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1267 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:59.955542 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-099ca530-b5e5-4279-89b0-5b9089a19fa3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:59.958529 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-099ca530-b5e5-4279-89b0-5b9089a19fa3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:00.061574 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-099ca530-b5e5-4279-89b0-5b9089a19fa3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:00.070182 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-099ca530-b5e5-4279-89b0-5b9089a19fa3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:00.071763 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-099ca530-b5e5-4279-89b0-5b9089a19fa3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:00.075053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-099ca530-b5e5-4279-89b0-5b9089a19fa3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1282 microversion: 2.20 time: 0.131335 May 25 15:03:00.075913 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 320/652] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:02:59 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1282 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:00.101809 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-38c2cf2e-c820-4b62-873d-151ee1c67009 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:00.116194 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-38c2cf2e-c820-4b62-873d-151ee1c67009 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 200 len: 1364 microversion: 2.1 time: 0.513872 May 25 15:03:00.116818 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 333/653] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:02:59 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 1364 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:00.968745 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8131eaaa-c41c-4113-81ff-62adafff3307 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:00.969925 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-8131eaaa-c41c-4113-81ff-62adafff3307 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:00.982738 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8131eaaa-c41c-4113-81ff-62adafff3307 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:00.983379 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8131eaaa-c41c-4113-81ff-62adafff3307 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:00.984309 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8131eaaa-c41c-4113-81ff-62adafff3307 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:00.984960 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8131eaaa-c41c-4113-81ff-62adafff3307 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:01.093023 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-da11b8c7-164b-47e8-a92a-4a5edfc6f958 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:01.093767 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-da11b8c7-164b-47e8-a92a-4a5edfc6f958 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:01.101507 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-da11b8c7-164b-47e8-a92a-4a5edfc6f958 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:01.101994 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-da11b8c7-164b-47e8-a92a-4a5edfc6f958 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:01.102848 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-da11b8c7-164b-47e8-a92a-4a5edfc6f958 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:01.103563 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-da11b8c7-164b-47e8-a92a-4a5edfc6f958 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:01.143105 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-8131eaaa-c41c-4113-81ff-62adafff3307 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:01.152869 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-8131eaaa-c41c-4113-81ff-62adafff3307 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1267 microversion: 2.1 time: 0.192572 May 25 15:03:01.154350 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 321/654] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:03:00 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:01.160954 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-fe657e7e-9c04-4f42-9c50-223705e80515 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:01.162060 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-fe657e7e-9c04-4f42-9c50-223705e80515 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:01.169330 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fe657e7e-9c04-4f42-9c50-223705e80515 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:01.169780 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fe657e7e-9c04-4f42-9c50-223705e80515 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:01.170610 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fe657e7e-9c04-4f42-9c50-223705e80515 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:01.171046 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fe657e7e-9c04-4f42-9c50-223705e80515 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:01.202601 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-da11b8c7-164b-47e8-a92a-4a5edfc6f958 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:01.205291 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:01.215521 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-da11b8c7-164b-47e8-a92a-4a5edfc6f958 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:01.217553 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-da11b8c7-164b-47e8-a92a-4a5edfc6f958 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:01.218980 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-da11b8c7-164b-47e8-a92a-4a5edfc6f958 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1278 microversion: 2.20 time: 0.130135 May 25 15:03:01.219721 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 334/655] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:03:01 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1278 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:01.349253 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-fe657e7e-9c04-4f42-9c50-223705e80515 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:01.358218 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-fe657e7e-9c04-4f42-9c50-223705e80515 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 200 len: 1364 microversion: 2.1 time: 0.202384 May 25 15:03:01.358924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 322/656] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:03:01 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:02.171123 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f5a516bf-79b6-4ebe-8776-7ec02627ba64 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:02.171678 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f5a516bf-79b6-4ebe-8776-7ec02627ba64 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:02.179478 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f5a516bf-79b6-4ebe-8776-7ec02627ba64 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:02.179930 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f5a516bf-79b6-4ebe-8776-7ec02627ba64 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:02.180758 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f5a516bf-79b6-4ebe-8776-7ec02627ba64 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:02.181141 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f5a516bf-79b6-4ebe-8776-7ec02627ba64 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:02.236980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-24364e51-a8fb-403d-8557-5103d8a69150 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:02.237572 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-24364e51-a8fb-403d-8557-5103d8a69150 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:02.244789 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-24364e51-a8fb-403d-8557-5103d8a69150 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:02.245284 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-24364e51-a8fb-403d-8557-5103d8a69150 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:02.246176 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-24364e51-a8fb-403d-8557-5103d8a69150 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:02.246614 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-24364e51-a8fb-403d-8557-5103d8a69150 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:02.323206 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-24364e51-a8fb-403d-8557-5103d8a69150 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:02.334264 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-24364e51-a8fb-403d-8557-5103d8a69150 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:02.336002 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-24364e51-a8fb-403d-8557-5103d8a69150 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:02.337191 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-24364e51-a8fb-403d-8557-5103d8a69150 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1334 microversion: 2.20 time: 0.104296 May 25 15:03:02.337761 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 323/657] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:03:02 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1334 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:03:02.338523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f5a516bf-79b6-4ebe-8776-7ec02627ba64 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:02.348569 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f5a516bf-79b6-4ebe-8776-7ec02627ba64 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1453 microversion: 2.1 time: 0.181726 May 25 15:03:02.349152 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 335/658] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:03:02 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1453 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:02.365653 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2d50d63c-4dd6-4011-ba42-74fcdf5beebb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:02.366297 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2d50d63c-4dd6-4011-ba42-74fcdf5beebb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:02.373023 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2d50d63c-4dd6-4011-ba42-74fcdf5beebb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:02.373472 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2d50d63c-4dd6-4011-ba42-74fcdf5beebb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:02.374291 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2d50d63c-4dd6-4011-ba42-74fcdf5beebb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:02.374731 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2d50d63c-4dd6-4011-ba42-74fcdf5beebb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:02.377598 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-71b5648d-b996-4ddf-b396-f66676f195ad tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:02.378316 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-71b5648d-b996-4ddf-b396-f66676f195ad tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:02.387254 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-71b5648d-b996-4ddf-b396-f66676f195ad tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:02.387733 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-71b5648d-b996-4ddf-b396-f66676f195ad tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:02.388524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-71b5648d-b996-4ddf-b396-f66676f195ad tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:02.388954 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-71b5648d-b996-4ddf-b396-f66676f195ad tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:02.620710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-2d50d63c-4dd6-4011-ba42-74fcdf5beebb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:02.629468 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2d50d63c-4dd6-4011-ba42-74fcdf5beebb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1453 microversion: 2.1 time: 0.267717 May 25 15:03:02.630523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-71b5648d-b996-4ddf-b396-f66676f195ad tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:02.642622 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 324/659] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:03:02 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1453 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:02.662567 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-71b5648d-b996-4ddf-b396-f66676f195ad tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 200 len: 1364 microversion: 2.1 time: 0.288974 May 25 15:03:02.686297 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 336/660] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:03:02 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 1364 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:02.715115 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-c6587cc0-a33f-4cb5-8a07-e2cc17e319fa req-96ef460a-da7c-4c78-86a4-74fc02b02d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d08c7580-ff9d-4f6a-894b-ec2805b4f883", "name": "network-vif-plugged", "status": "completed", "tag": "abb2be77-3e38-420c-873c-fc5389d260f3"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:03:02.731111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-c6587cc0-a33f-4cb5-8a07-e2cc17e319fa req-96ef460a-da7c-4c78-86a4-74fc02b02d85 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:02.732031 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-c6587cc0-a33f-4cb5-8a07-e2cc17e319fa req-96ef460a-da7c-4c78-86a4-74fc02b02d85 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:02.750559 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-c6587cc0-a33f-4cb5-8a07-e2cc17e319fa req-96ef460a-da7c-4c78-86a4-74fc02b02d85 service nova] Creating event network-vif-plugged:abb2be77-3e38-420c-873c-fc5389d260f3 for instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 on hv-cinder-80382 May 25 15:03:02.758927 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-c6587cc0-a33f-4cb5-8a07-e2cc17e319fa req-96ef460a-da7c-4c78-86a4-74fc02b02d85 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046911 May 25 15:03:02.760495 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 325/661] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:03.360000 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-417793cd-eebe-4168-95fa-5c1836c41f58 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:03.362515 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-417793cd-eebe-4168-95fa-5c1836c41f58 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:03.375197 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-417793cd-eebe-4168-95fa-5c1836c41f58 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:03.376543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-417793cd-eebe-4168-95fa-5c1836c41f58 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:03.378304 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-417793cd-eebe-4168-95fa-5c1836c41f58 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:03.379094 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-417793cd-eebe-4168-95fa-5c1836c41f58 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:03.490612 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-417793cd-eebe-4168-95fa-5c1836c41f58 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:03.504735 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-417793cd-eebe-4168-95fa-5c1836c41f58 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:03.508462 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-417793cd-eebe-4168-95fa-5c1836c41f58 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:03.511605 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-417793cd-eebe-4168-95fa-5c1836c41f58 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1340 microversion: 2.20 time: 0.157914 May 25 15:03:03.512955 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 337/662] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:03:03 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1340 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:03:03.693659 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-fde32883-3b8d-4c6b-aafd-e65684348a08 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:03.695236 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-fde32883-3b8d-4c6b-aafd-e65684348a08 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:03.703282 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fde32883-3b8d-4c6b-aafd-e65684348a08 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:03.704122 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fde32883-3b8d-4c6b-aafd-e65684348a08 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:03.705235 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fde32883-3b8d-4c6b-aafd-e65684348a08 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:03.705935 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fde32883-3b8d-4c6b-aafd-e65684348a08 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:03.949678 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-fde32883-3b8d-4c6b-aafd-e65684348a08 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:03.960148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-fde32883-3b8d-4c6b-aafd-e65684348a08 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 200 len: 1364 microversion: 2.1 time: 0.270489 May 25 15:03:03.961220 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 326/663] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:03:03 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:04.537666 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-00cf1f13-ed21-45aa-af07-44dbbd389361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:04.539393 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-00cf1f13-ed21-45aa-af07-44dbbd389361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:04.546807 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-00cf1f13-ed21-45aa-af07-44dbbd389361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:04.547631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-00cf1f13-ed21-45aa-af07-44dbbd389361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:04.548609 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-00cf1f13-ed21-45aa-af07-44dbbd389361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:04.549459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-00cf1f13-ed21-45aa-af07-44dbbd389361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:04.755116 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-00cf1f13-ed21-45aa-af07-44dbbd389361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:04.767399 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-00cf1f13-ed21-45aa-af07-44dbbd389361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:04.769012 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-00cf1f13-ed21-45aa-af07-44dbbd389361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:04.770421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-00cf1f13-ed21-45aa-af07-44dbbd389361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1407 microversion: 2.20 time: 0.236916 May 25 15:03:04.770984 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 338/664] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:03:04 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:04.893584 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-0ce96654-50c7-426c-b19c-09fc8164168f req-11310fd6-8733-47a6-a8c5-b019010dcf4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62cd86f-b289-4006-bd52-2dad10b43e93", "tag": "fd6e6b51-3ed9-43c2-8f3a-8d7ad380c206"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:03:04.909788 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-0ce96654-50c7-426c-b19c-09fc8164168f req-11310fd6-8733-47a6-a8c5-b019010dcf4d service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:04.910730 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-0ce96654-50c7-426c-b19c-09fc8164168f req-11310fd6-8733-47a6-a8c5-b019010dcf4d service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:04.937249 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-0ce96654-50c7-426c-b19c-09fc8164168f req-11310fd6-8733-47a6-a8c5-b019010dcf4d service nova] Creating event network-changed:fd6e6b51-3ed9-43c2-8f3a-8d7ad380c206 for instance d62cd86f-b289-4006-bd52-2dad10b43e93 on hv-cinder-80382 May 25 15:03:04.944266 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-0ce96654-50c7-426c-b19c-09fc8164168f req-11310fd6-8733-47a6-a8c5-b019010dcf4d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060466 May 25 15:03:04.945460 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 327/665] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:04.978922 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-9364c819-1508-41d2-97ce-64883b3a3771 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:04.979660 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-9364c819-1508-41d2-97ce-64883b3a3771 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:04.988104 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9364c819-1508-41d2-97ce-64883b3a3771 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:04.988585 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9364c819-1508-41d2-97ce-64883b3a3771 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:04.989410 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9364c819-1508-41d2-97ce-64883b3a3771 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:04.989859 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9364c819-1508-41d2-97ce-64883b3a3771 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:05.251715 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-287d3819-25c8-45ac-af59-e63c5e282e1e req-6b7b1711-3e66-403f-979e-1bddec18767b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "879adce9-e352-4e39-b80b-dcaee814c084", "tag": "1f402e27-3709-41db-8b59-49501ea83eb5"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:03:05.255281 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-9364c819-1508-41d2-97ce-64883b3a3771 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:05.268559 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-287d3819-25c8-45ac-af59-e63c5e282e1e req-6b7b1711-3e66-403f-979e-1bddec18767b service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:05.271522 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-9364c819-1508-41d2-97ce-64883b3a3771 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 200 len: 1554 microversion: 2.1 time: 0.295215 May 25 15:03:05.283248 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-287d3819-25c8-45ac-af59-e63c5e282e1e req-6b7b1711-3e66-403f-979e-1bddec18767b service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:05.285447 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 339/666] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:03:04 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 1554 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:05.297606 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-543a82f4-36e4-4518-9046-ab89f5b99d8b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:05.298158 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-543a82f4-36e4-4518-9046-ab89f5b99d8b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:05.311262 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-287d3819-25c8-45ac-af59-e63c5e282e1e req-6b7b1711-3e66-403f-979e-1bddec18767b service nova] Creating event network-changed:1f402e27-3709-41db-8b59-49501ea83eb5 for instance 879adce9-e352-4e39-b80b-dcaee814c084 on hv-cinder-80382 May 25 15:03:05.314918 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-543a82f4-36e4-4518-9046-ab89f5b99d8b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:05.315304 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-543a82f4-36e4-4518-9046-ab89f5b99d8b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:05.317609 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-543a82f4-36e4-4518-9046-ab89f5b99d8b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:05.318301 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-543a82f4-36e4-4518-9046-ab89f5b99d8b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:05.319980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-287d3819-25c8-45ac-af59-e63c5e282e1e req-6b7b1711-3e66-403f-979e-1bddec18767b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075101 May 25 15:03:05.323929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 328/667] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:03:05.418294 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-543a82f4-36e4-4518-9046-ab89f5b99d8b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131508 May 25 15:03:05.419183 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 340/668] 10.222.0.78 () {58 vars in 1274 bytes} [Wed May 25 15:03:05 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:05.792990 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a9e7078e-b893-4a33-ae4d-ba80bb6d837f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:05.794925 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-a9e7078e-b893-4a33-ae4d-ba80bb6d837f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:05.806875 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a9e7078e-b893-4a33-ae4d-ba80bb6d837f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:05.808131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a9e7078e-b893-4a33-ae4d-ba80bb6d837f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:05.809611 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a9e7078e-b893-4a33-ae4d-ba80bb6d837f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:05.810701 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a9e7078e-b893-4a33-ae4d-ba80bb6d837f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:06.385254 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-a9e7078e-b893-4a33-ae4d-ba80bb6d837f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:06.399438 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-a9e7078e-b893-4a33-ae4d-ba80bb6d837f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:06.403303 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-a9e7078e-b893-4a33-ae4d-ba80bb6d837f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:06.405152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-a9e7078e-b893-4a33-ae4d-ba80bb6d837f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1407 microversion: 2.20 time: 0.620717 May 25 15:03:06.405791 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 329/669] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:03:05 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1407 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:07.093890 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-3dab90b3-d260-471f-a3fe-e4d28a8edd23 req-a7e2fbee-fd74-4585-a669-47d9f6ba2db2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d08c7580-ff9d-4f6a-894b-ec2805b4f883", "tag": "abb2be77-3e38-420c-873c-fc5389d260f3"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:03:07.103135 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-3dab90b3-d260-471f-a3fe-e4d28a8edd23 req-a7e2fbee-fd74-4585-a669-47d9f6ba2db2 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:07.103583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-3dab90b3-d260-471f-a3fe-e4d28a8edd23 req-a7e2fbee-fd74-4585-a669-47d9f6ba2db2 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:07.117167 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-3dab90b3-d260-471f-a3fe-e4d28a8edd23 req-a7e2fbee-fd74-4585-a669-47d9f6ba2db2 service nova] Creating event network-changed:abb2be77-3e38-420c-873c-fc5389d260f3 for instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 on hv-cinder-80382 May 25 15:03:07.123063 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-3dab90b3-d260-471f-a3fe-e4d28a8edd23 req-a7e2fbee-fd74-4585-a669-47d9f6ba2db2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034508 May 25 15:03:07.123645 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 341/670] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:07.426034 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-e1277965-3cc2-4469-bc02-dc90a6390a79 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:07.427372 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-e1277965-3cc2-4469-bc02-dc90a6390a79 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:07.438309 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e1277965-3cc2-4469-bc02-dc90a6390a79 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:07.449728 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e1277965-3cc2-4469-bc02-dc90a6390a79 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:07.450860 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e1277965-3cc2-4469-bc02-dc90a6390a79 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:07.451317 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e1277965-3cc2-4469-bc02-dc90a6390a79 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:07.791889 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-e1277965-3cc2-4469-bc02-dc90a6390a79 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:07.816871 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-e1277965-3cc2-4469-bc02-dc90a6390a79 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:07.819745 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-e1277965-3cc2-4469-bc02-dc90a6390a79 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:07.821897 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-e1277965-3cc2-4469-bc02-dc90a6390a79 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1407 microversion: 2.20 time: 0.402592 May 25 15:03:07.823018 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 330/671] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:03:07 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:08.525022 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-570aad79-ac90-4024-9af4-feb90e561ccf tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:08.527547 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-570aad79-ac90-4024-9af4-feb90e561ccf tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:08.536632 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-570aad79-ac90-4024-9af4-feb90e561ccf tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:08.537112 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-570aad79-ac90-4024-9af4-feb90e561ccf tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:08.538217 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-570aad79-ac90-4024-9af4-feb90e561ccf tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:08.538865 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-570aad79-ac90-4024-9af4-feb90e561ccf tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:08.573612 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-570aad79-ac90-4024-9af4-feb90e561ccf tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057076 May 25 15:03:08.574255 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 342/672] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:03:08 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:08.587180 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-70ce7fef-5831-4c4c-91f0-9cbc5bf2634d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:08.587870 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-70ce7fef-5831-4c4c-91f0-9cbc5bf2634d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:08.598758 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-70ce7fef-5831-4c4c-91f0-9cbc5bf2634d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:08.599401 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-70ce7fef-5831-4c4c-91f0-9cbc5bf2634d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:08.600576 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-70ce7fef-5831-4c4c-91f0-9cbc5bf2634d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:08.601239 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-70ce7fef-5831-4c4c-91f0-9cbc5bf2634d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:08.637653 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-70ce7fef-5831-4c4c-91f0-9cbc5bf2634d tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments/c03c1ed9-0e46-4599-b422-b315ed122300" status: 200 len: 194 microversion: 2.1 time: 0.056637 May 25 15:03:08.638319 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 331/673] 10.222.0.78 () {58 vars in 1412 bytes} [Wed May 25 15:03:08 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments/c03c1ed9-0e46-4599-b422-b315ed122300 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:08.841235 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ff9a24dc-2d32-451c-bcad-8a0c5de37328 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:08.841849 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ff9a24dc-2d32-451c-bcad-8a0c5de37328 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:08.848519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ff9a24dc-2d32-451c-bcad-8a0c5de37328 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:08.848968 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ff9a24dc-2d32-451c-bcad-8a0c5de37328 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:08.849769 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ff9a24dc-2d32-451c-bcad-8a0c5de37328 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:08.850262 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ff9a24dc-2d32-451c-bcad-8a0c5de37328 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:09.047560 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ff9a24dc-2d32-451c-bcad-8a0c5de37328 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:09.059159 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ff9a24dc-2d32-451c-bcad-8a0c5de37328 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:09.060974 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ff9a24dc-2d32-451c-bcad-8a0c5de37328 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:09.062298 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ff9a24dc-2d32-451c-bcad-8a0c5de37328 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1407 microversion: 2.20 time: 0.225501 May 25 15:03:09.062871 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 343/674] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:03:08 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:10.074248 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-fb330153-e556-4538-8f2f-408ee2c68cbf tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1f2a272-285c-4c15-bf5a-f21ae5367a08"}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:03:10.075461 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-fb330153-e556-4538-8f2f-408ee2c68cbf tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:10.077846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=6 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:10.079414 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=28 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:10.080770 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0791a863-8c8e-4653-9fd4-04cba64a1708 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:10.081547 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-0791a863-8c8e-4653-9fd4-04cba64a1708 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:10.086854 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fb330153-e556-4538-8f2f-408ee2c68cbf tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:10.087306 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fb330153-e556-4538-8f2f-408ee2c68cbf tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:10.088106 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fb330153-e556-4538-8f2f-408ee2c68cbf tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:10.088538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fb330153-e556-4538-8f2f-408ee2c68cbf tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:10.089475 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0791a863-8c8e-4653-9fd4-04cba64a1708 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:10.089926 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0791a863-8c8e-4653-9fd4-04cba64a1708 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:10.090761 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0791a863-8c8e-4653-9fd4-04cba64a1708 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:10.091202 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0791a863-8c8e-4653-9fd4-04cba64a1708 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:10.246493 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-0791a863-8c8e-4653-9fd4-04cba64a1708 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:10.255991 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-0791a863-8c8e-4653-9fd4-04cba64a1708 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:10.257844 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-0791a863-8c8e-4653-9fd4-04cba64a1708 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:10.259552 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-0791a863-8c8e-4653-9fd4-04cba64a1708 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1407 microversion: 2.20 time: 0.182971 May 25 15:03:10.260330 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 344/675] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:03:10 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:03:10.405112 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-fb330153-e556-4538-8f2f-408ee2c68cbf tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "POST /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335339 May 25 15:03:10.405792 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 332/676] 10.222.0.78 () {60 vars in 1322 bytes} [Wed May 25 15:03:10 2022] POST /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:03:11.280346 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-1ffa4f47-ba72-4560-bb31-6d344f8f6b42 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:11.280966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-1ffa4f47-ba72-4560-bb31-6d344f8f6b42 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:11.288301 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1ffa4f47-ba72-4560-bb31-6d344f8f6b42 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:11.289316 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1ffa4f47-ba72-4560-bb31-6d344f8f6b42 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:11.290358 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1ffa4f47-ba72-4560-bb31-6d344f8f6b42 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:11.290875 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1ffa4f47-ba72-4560-bb31-6d344f8f6b42 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:11.436541 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-1ffa4f47-ba72-4560-bb31-6d344f8f6b42 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:11.446630 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-1ffa4f47-ba72-4560-bb31-6d344f8f6b42 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:11.448163 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-1ffa4f47-ba72-4560-bb31-6d344f8f6b42 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:11.449891 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-1ffa4f47-ba72-4560-bb31-6d344f8f6b42 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1407 microversion: 2.20 time: 0.175349 May 25 15:03:11.450501 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 345/677] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:03:11 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:12.468757 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-eceaf9fa-3edc-49ad-86b1-9bd6837215b2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:12.469641 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-eceaf9fa-3edc-49ad-86b1-9bd6837215b2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:12.475890 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-eceaf9fa-3edc-49ad-86b1-9bd6837215b2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:12.476338 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-eceaf9fa-3edc-49ad-86b1-9bd6837215b2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:12.477103 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-eceaf9fa-3edc-49ad-86b1-9bd6837215b2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:12.477540 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-eceaf9fa-3edc-49ad-86b1-9bd6837215b2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:12.617599 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-eceaf9fa-3edc-49ad-86b1-9bd6837215b2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:12.627016 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-eceaf9fa-3edc-49ad-86b1-9bd6837215b2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:12.628510 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-eceaf9fa-3edc-49ad-86b1-9bd6837215b2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:12.629619 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-eceaf9fa-3edc-49ad-86b1-9bd6837215b2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1407 microversion: 2.20 time: 0.165708 May 25 15:03:12.630211 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 333/678] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:03:12 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:12.703192 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-19eb8eab-90a2-40ed-8de1-61e881e44085 req-ad54fdd2-e31f-4ed6-a8a5-b6a29a3ba837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879adce9-e352-4e39-b80b-dcaee814c084", "name": "network-vif-plugged", "status": "completed", "tag": "1f402e27-3709-41db-8b59-49501ea83eb5"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:03:12.712159 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-19eb8eab-90a2-40ed-8de1-61e881e44085 req-ad54fdd2-e31f-4ed6-a8a5-b6a29a3ba837 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:12.712669 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-19eb8eab-90a2-40ed-8de1-61e881e44085 req-ad54fdd2-e31f-4ed6-a8a5-b6a29a3ba837 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:12.725162 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-19eb8eab-90a2-40ed-8de1-61e881e44085 req-ad54fdd2-e31f-4ed6-a8a5-b6a29a3ba837 service nova] Creating event network-vif-plugged:1f402e27-3709-41db-8b59-49501ea83eb5 for instance 879adce9-e352-4e39-b80b-dcaee814c084 on hv-cinder-80382 May 25 15:03:12.730473 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-19eb8eab-90a2-40ed-8de1-61e881e44085 req-ad54fdd2-e31f-4ed6-a8a5-b6a29a3ba837 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030429 May 25 15:03:12.731073 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 346/679] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:13.647071 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6cd78918-0925-4bf1-bfc0-2f84c21afab1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:13.647677 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6cd78918-0925-4bf1-bfc0-2f84c21afab1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:13.654906 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6cd78918-0925-4bf1-bfc0-2f84c21afab1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:13.655352 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6cd78918-0925-4bf1-bfc0-2f84c21afab1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:13.656111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6cd78918-0925-4bf1-bfc0-2f84c21afab1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:13.656542 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6cd78918-0925-4bf1-bfc0-2f84c21afab1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:13.671348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:13.790714 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6cd78918-0925-4bf1-bfc0-2f84c21afab1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:13.798783 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6cd78918-0925-4bf1-bfc0-2f84c21afab1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:13.800295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6cd78918-0925-4bf1-bfc0-2f84c21afab1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:13.801389 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6cd78918-0925-4bf1-bfc0-2f84c21afab1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1407 microversion: 2.20 time: 0.158294 May 25 15:03:13.801942 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 334/680] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:03:13 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:14.820922 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-29634eb8-6154-42f1-be29-b0e0a9089ca9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:14.821627 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-29634eb8-6154-42f1-be29-b0e0a9089ca9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:14.827896 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-29634eb8-6154-42f1-be29-b0e0a9089ca9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:14.828345 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-29634eb8-6154-42f1-be29-b0e0a9089ca9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:14.829109 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-29634eb8-6154-42f1-be29-b0e0a9089ca9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:14.829553 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-29634eb8-6154-42f1-be29-b0e0a9089ca9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:14.992096 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-29634eb8-6154-42f1-be29-b0e0a9089ca9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:15.000064 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-29634eb8-6154-42f1-be29-b0e0a9089ca9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:15.001569 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-29634eb8-6154-42f1-be29-b0e0a9089ca9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:15.002757 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-29634eb8-6154-42f1-be29-b0e0a9089ca9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1599 microversion: 2.20 time: 0.186720 May 25 15:03:15.003311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 347/681] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:03:14 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1599 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:15.020036 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-53977ec5-f779-468f-b22d-bf9eeebe5d25 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:15.020553 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-53977ec5-f779-468f-b22d-bf9eeebe5d25 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:15.022864 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:15.029024 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-53977ec5-f779-468f-b22d-bf9eeebe5d25 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:15.029464 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-53977ec5-f779-468f-b22d-bf9eeebe5d25 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:15.030263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-53977ec5-f779-468f-b22d-bf9eeebe5d25 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:15.030695 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-53977ec5-f779-468f-b22d-bf9eeebe5d25 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:15.111138 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-53977ec5-f779-468f-b22d-bf9eeebe5d25 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094966 May 25 15:03:15.111746 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 335/682] 10.222.0.78 () {60 vars in 1315 bytes} [Wed May 25 15:03:15 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:03:16.328070 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-70b98478-7e43-434a-b149-550fc81a6e38 req-91c546e0-ab0a-4548-bf1f-e892cda4fd58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "879adce9-e352-4e39-b80b-dcaee814c084", "tag": "1f402e27-3709-41db-8b59-49501ea83eb5"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:03:16.344029 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-70b98478-7e43-434a-b149-550fc81a6e38 req-91c546e0-ab0a-4548-bf1f-e892cda4fd58 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:16.344029 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-70b98478-7e43-434a-b149-550fc81a6e38 req-91c546e0-ab0a-4548-bf1f-e892cda4fd58 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:16.349785 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-70b98478-7e43-434a-b149-550fc81a6e38 req-91c546e0-ab0a-4548-bf1f-e892cda4fd58 service nova] Creating event network-changed:1f402e27-3709-41db-8b59-49501ea83eb5 for instance 879adce9-e352-4e39-b80b-dcaee814c084 on hv-cinder-80382 May 25 15:03:16.354914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-70b98478-7e43-434a-b149-550fc81a6e38 req-91c546e0-ab0a-4548-bf1f-e892cda4fd58 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030453 May 25 15:03:16.355690 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 348/683] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:18.992455 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-666afa06-54e4-4c2a-b0a9-f0d82c414ad8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:18.993387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-666afa06-54e4-4c2a-b0a9-f0d82c414ad8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:19.000700 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-666afa06-54e4-4c2a-b0a9-f0d82c414ad8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:19.001146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-666afa06-54e4-4c2a-b0a9-f0d82c414ad8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:19.001927 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-666afa06-54e4-4c2a-b0a9-f0d82c414ad8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:19.002389 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-666afa06-54e4-4c2a-b0a9-f0d82c414ad8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:19.034176 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-666afa06-54e4-4c2a-b0a9-f0d82c414ad8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046520 May 25 15:03:19.034745 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 336/684] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:03:18 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:19.198118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-64996729-0fb6-4b40-8423-244fc2f15850 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:19.198657 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-64996729-0fb6-4b40-8423-244fc2f15850 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:19.204845 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-64996729-0fb6-4b40-8423-244fc2f15850 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:19.205291 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-64996729-0fb6-4b40-8423-244fc2f15850 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:19.206078 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-64996729-0fb6-4b40-8423-244fc2f15850 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:19.206516 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-64996729-0fb6-4b40-8423-244fc2f15850 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:19.234534 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-64996729-0fb6-4b40-8423-244fc2f15850 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments/c03c1ed9-0e46-4599-b422-b315ed122300" status: 200 len: 194 microversion: 2.1 time: 0.041243 May 25 15:03:19.235101 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 349/685] 10.222.0.78 () {58 vars in 1412 bytes} [Wed May 25 15:03:19 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments/c03c1ed9-0e46-4599-b422-b315ed122300 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:03:19.244905 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0e4cc346-6f13-45a1-ae17-aa4ad72ff2bd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:19.245435 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0e4cc346-6f13-45a1-ae17-aa4ad72ff2bd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:19.252136 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0e4cc346-6f13-45a1-ae17-aa4ad72ff2bd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:19.252582 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0e4cc346-6f13-45a1-ae17-aa4ad72ff2bd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:19.253383 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0e4cc346-6f13-45a1-ae17-aa4ad72ff2bd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:19.253819 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0e4cc346-6f13-45a1-ae17-aa4ad72ff2bd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:19.335948 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-0e4cc346-6f13-45a1-ae17-aa4ad72ff2bd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lazy-loading 'services' on Instance uuid 0c199bd9-ce9c-4761-9f84-042971621d9c {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:03:19.411459 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0e4cc346-6f13-45a1-ae17-aa4ad72ff2bd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments/c03c1ed9-0e46-4599-b422-b315ed122300" status: 202 len: 0 microversion: 2.1 time: 0.170355 May 25 15:03:19.412071 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 337/686] 10.222.0.78 () {58 vars in 1415 bytes} [Wed May 25 15:03:19 2022] DELETE /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments/c03c1ed9-0e46-4599-b422-b315ed122300 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:03:21.585902 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8a550df4-da14-403b-a2eb-95ea662fb00b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:21.586582 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8a550df4-da14-403b-a2eb-95ea662fb00b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:21.589102 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:21.594911 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8a550df4-da14-403b-a2eb-95ea662fb00b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:21.595366 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8a550df4-da14-403b-a2eb-95ea662fb00b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:21.596154 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8a550df4-da14-403b-a2eb-95ea662fb00b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:21.596594 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8a550df4-da14-403b-a2eb-95ea662fb00b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:21.628765 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8a550df4-da14-403b-a2eb-95ea662fb00b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments/e1f2a272-285c-4c15-bf5a-f21ae5367a08" status: 200 len: 194 microversion: 2.1 time: 0.046841 May 25 15:03:21.629370 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 350/687] 10.222.0.78 () {58 vars in 1412 bytes} [Wed May 25 15:03:21 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments/e1f2a272-285c-4c15-bf5a-f21ae5367a08 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:21.640823 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8be09068-aefe-4bbe-93d8-4b402d04c104 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:21.641444 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-8be09068-aefe-4bbe-93d8-4b402d04c104 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:21.648383 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8be09068-aefe-4bbe-93d8-4b402d04c104 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:21.648824 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8be09068-aefe-4bbe-93d8-4b402d04c104 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:21.649598 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8be09068-aefe-4bbe-93d8-4b402d04c104 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:21.650052 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8be09068-aefe-4bbe-93d8-4b402d04c104 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:21.736757 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-8be09068-aefe-4bbe-93d8-4b402d04c104 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lazy-loading 'services' on Instance uuid 0c199bd9-ce9c-4761-9f84-042971621d9c {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:03:21.827021 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-8be09068-aefe-4bbe-93d8-4b402d04c104 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments/e1f2a272-285c-4c15-bf5a-f21ae5367a08" status: 202 len: 0 microversion: 2.1 time: 0.190479 May 25 15:03:21.827639 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 338/688] 10.222.0.78 () {58 vars in 1415 bytes} [Wed May 25 15:03:21 2022] DELETE /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments/e1f2a272-285c-4c15-bf5a-f21ae5367a08 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:03:24.072587 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-1b654351-d2c1-4679-893b-4e247b6c36bd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:24.074269 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-1b654351-d2c1-4679-893b-4e247b6c36bd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:24.081466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1b654351-d2c1-4679-893b-4e247b6c36bd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:24.081921 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1b654351-d2c1-4679-893b-4e247b6c36bd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:24.082724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1b654351-d2c1-4679-893b-4e247b6c36bd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:24.083169 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1b654351-d2c1-4679-893b-4e247b6c36bd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:24.118576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-1b654351-d2c1-4679-893b-4e247b6c36bd tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052056 May 25 15:03:24.119205 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 351/689] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:03:24 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:03:24.240365 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b4bb09f0-98d6-40a0-8985-5269373b4067 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:24.241458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b4bb09f0-98d6-40a0-8985-5269373b4067 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:24.248952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b4bb09f0-98d6-40a0-8985-5269373b4067 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:24.249414 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b4bb09f0-98d6-40a0-8985-5269373b4067 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:24.250238 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b4bb09f0-98d6-40a0-8985-5269373b4067 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:24.250677 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b4bb09f0-98d6-40a0-8985-5269373b4067 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:24.281744 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b4bb09f0-98d6-40a0-8985-5269373b4067 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045974 May 25 15:03:24.282346 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 339/690] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:03:24 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:03:24.344910 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-43f80af6-f2e1-49b6-bd7b-a06e1eaa611b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:24.345413 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-43f80af6-f2e1-49b6-bd7b-a06e1eaa611b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:24.351866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-43f80af6-f2e1-49b6-bd7b-a06e1eaa611b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:24.352321 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-43f80af6-f2e1-49b6-bd7b-a06e1eaa611b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:24.353096 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-43f80af6-f2e1-49b6-bd7b-a06e1eaa611b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:24.353536 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-43f80af6-f2e1-49b6-bd7b-a06e1eaa611b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:24.379355 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-43f80af6-f2e1-49b6-bd7b-a06e1eaa611b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Going to try to terminate instance {{(pid=124523) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:03:24.416437 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:24.460597 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-43f80af6-f2e1-49b6-bd7b-a06e1eaa611b tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 204 len: 0 microversion: 2.1 time: 0.119858 May 25 15:03:24.461186 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 352/691] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:03:24 2022] DELETE /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:03:24.469979 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6135a869-d06c-4493-9aa0-361b59967241 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:24.470640 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6135a869-d06c-4493-9aa0-361b59967241 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:24.476978 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6135a869-d06c-4493-9aa0-361b59967241 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:24.477457 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6135a869-d06c-4493-9aa0-361b59967241 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:24.478301 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6135a869-d06c-4493-9aa0-361b59967241 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:24.478741 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6135a869-d06c-4493-9aa0-361b59967241 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:24.624157 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6135a869-d06c-4493-9aa0-361b59967241 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:24.632062 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6135a869-d06c-4493-9aa0-361b59967241 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 200 len: 1671 microversion: 2.1 time: 0.166411 May 25 15:03:24.632654 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 340/692] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:03:24 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:25.659410 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-20da28ba-ddf1-4464-9190-4654dfb9eaa5 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:25.660114 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-20da28ba-ddf1-4464-9190-4654dfb9eaa5 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:25.666877 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-20da28ba-ddf1-4464-9190-4654dfb9eaa5 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:25.667320 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-20da28ba-ddf1-4464-9190-4654dfb9eaa5 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:25.668090 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-20da28ba-ddf1-4464-9190-4654dfb9eaa5 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:25.668525 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-20da28ba-ddf1-4464-9190-4654dfb9eaa5 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:25.801767 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-20da28ba-ddf1-4464-9190-4654dfb9eaa5 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:25.809607 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-20da28ba-ddf1-4464-9190-4654dfb9eaa5 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 200 len: 1671 microversion: 2.1 time: 0.154361 May 25 15:03:25.810215 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 353/693] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:03:25 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:26.827105 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0823b46c-7363-40a7-b845-c071f5e30935 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:26.827720 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0823b46c-7363-40a7-b845-c071f5e30935 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:26.834368 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0823b46c-7363-40a7-b845-c071f5e30935 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:26.834811 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0823b46c-7363-40a7-b845-c071f5e30935 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:26.835579 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0823b46c-7363-40a7-b845-c071f5e30935 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:26.836005 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0823b46c-7363-40a7-b845-c071f5e30935 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:26.970680 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-0823b46c-7363-40a7-b845-c071f5e30935 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:26.978531 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0823b46c-7363-40a7-b845-c071f5e30935 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 200 len: 1671 microversion: 2.1 time: 0.155537 May 25 15:03:26.979110 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 341/694] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:03:26 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:27.995998 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-981b7076-6393-4649-b7e7-98094ad402ce tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:27.996628 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-981b7076-6393-4649-b7e7-98094ad402ce tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:28.003226 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-981b7076-6393-4649-b7e7-98094ad402ce tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:28.003669 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-981b7076-6393-4649-b7e7-98094ad402ce tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:28.004453 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-981b7076-6393-4649-b7e7-98094ad402ce tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:28.004884 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-981b7076-6393-4649-b7e7-98094ad402ce tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:28.246248 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-981b7076-6393-4649-b7e7-98094ad402ce tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:28.253795 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-981b7076-6393-4649-b7e7-98094ad402ce tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 200 len: 1671 microversion: 2.1 time: 0.261634 May 25 15:03:28.254397 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 354/695] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:03:27 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 1671 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:28.691910 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-76204c0f-1297-4773-bf2a-6e92bc695b2f req-a7ed3a06-c54b-44d3-b47d-706bfdfb74cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c199bd9-ce9c-4761-9f84-042971621d9c", "name": "network-vif-deleted", "tag": "e879175d-ad6e-45f8-890b-d64ddeb1ddf4"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:03:28.700223 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-76204c0f-1297-4773-bf2a-6e92bc695b2f req-a7ed3a06-c54b-44d3-b47d-706bfdfb74cb service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:28.700657 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-76204c0f-1297-4773-bf2a-6e92bc695b2f req-a7ed3a06-c54b-44d3-b47d-706bfdfb74cb service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:28.713026 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-76204c0f-1297-4773-bf2a-6e92bc695b2f req-a7ed3a06-c54b-44d3-b47d-706bfdfb74cb service nova] Creating event network-vif-deleted:e879175d-ad6e-45f8-890b-d64ddeb1ddf4 for instance 0c199bd9-ce9c-4761-9f84-042971621d9c on hv-cinder-80382 May 25 15:03:28.718405 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-76204c0f-1297-4773-bf2a-6e92bc695b2f req-a7ed3a06-c54b-44d3-b47d-706bfdfb74cb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030145 May 25 15:03:28.719167 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 342/696] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:29.271600 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-6032ce5f-607b-4804-90de-104c12d74b77 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:29.272228 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-6032ce5f-607b-4804-90de-104c12d74b77 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:29.278885 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6032ce5f-607b-4804-90de-104c12d74b77 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:29.280188 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6032ce5f-607b-4804-90de-104c12d74b77 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:29.281020 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6032ce5f-607b-4804-90de-104c12d74b77 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:29.281463 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6032ce5f-607b-4804-90de-104c12d74b77 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:29.316389 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6032ce5f-607b-4804-90de-104c12d74b77 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:29.316843 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6032ce5f-607b-4804-90de-104c12d74b77 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:29.317302 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.objects.instance [None req-6032ce5f-607b-4804-90de-104c12d74b77 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lazy-loading 'fault' on Instance uuid 0c199bd9-ce9c-4761-9f84-042971621d9c {{(pid=124523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:03:29.366134 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-6032ce5f-607b-4804-90de-104c12d74b77 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fedb9b92e9a4e3cb671f69751e426a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395f31fad3645c19096d648c521bf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:29.373875 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-6032ce5f-607b-4804-90de-104c12d74b77 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 200 len: 1326 microversion: 2.1 time: 0.106115 May 25 15:03:29.374757 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 355/697] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:03:29 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 1326 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:30.392916 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d84980ed-6d1b-4a48-85cf-4a4e0c5409df tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:30.393892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d84980ed-6d1b-4a48-85cf-4a4e0c5409df tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:30.405754 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d84980ed-6d1b-4a48-85cf-4a4e0c5409df tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:30.406242 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d84980ed-6d1b-4a48-85cf-4a4e0c5409df tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:30.407028 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d84980ed-6d1b-4a48-85cf-4a4e0c5409df tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:30.407477 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d84980ed-6d1b-4a48-85cf-4a4e0c5409df tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:30.421954 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-d84980ed-6d1b-4a48-85cf-4a4e0c5409df tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] HTTP exception thrown: Instance 0c199bd9-ce9c-4761-9f84-042971621d9c could not be found. May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d84980ed-6d1b-4a48-85cf-4a4e0c5409df tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Request method failure captured: May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c HTTP/1.1 May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkOMGxLp5La0duucSziDTnmPb4MU3_K5UmVHkmMTzOrKf4CDiWgoAAMnWidsfANdWM6N22uaVZw8H4Gi4s6gZps3-l9ke1k9LwV8gtAhQi1hEe9iYagGpPwWa0uPizubIvmE_UQXOMQcsRQ7l6vRyCvGnhYjwCuJur35xzymhn2liVU May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 2395f31fad3645c19096d648c521bf31 May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-AttachVolumeTestJSON-925279656 May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:03:30.423691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:03:30.425259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2395f31fad3645c19096d648c521bf31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2395f31fad3645c19096d648c521bf31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2395f31fad3645c19096d648c521bf31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2395f31fad3645c19096d648c521bf31"}]}] May 25 15:03:30.425259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-AttachVolumeTestJSON-925279656 May 25 15:03:30.425259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 2395f31fad3645c19096d648c521bf31 May 25 15:03:30.425259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-AttachVolumeTestJSON-925279656 May 25 15:03:30.425259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-AttachVolumeTestJSON-925279656-project May 25 15:03:30.425259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:03:30.425259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:03:30.425259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: 7fedb9b92e9a4e3cb671f69751e426a1 May 25 15:03:30.425259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-AttachVolumeTestJSON-925279656-project May 25 15:03:30.425259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:03:30.425259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance 0c199bd9-ce9c-4761-9f84-042971621d9c could not be found. May 25 15:03:30.425259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': '0c199bd9-ce9c-4761-9f84-042971621d9c'} May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c199bd9-ce9c-4761-9f84-042971621d9c could not be found. May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:03:30.426255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:03:30.427941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:03:30.427941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:03:30.427941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:03:30.427941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:03:30.427941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:03:30.427941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:03:30.427941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:03:30.427941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c199bd9-ce9c-4761-9f84-042971621d9c could not be found. May 25 15:03:30.427941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:03:30.427941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:03:30.427941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:03:30.427941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:30.427941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:03:30.427941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:03:30.427941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:03:30.427941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:03:30.427941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c199bd9-ce9c-4761-9f84-042971621d9c could not be found. May 25 15:03:30.427941 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:03:30.429527 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d84980ed-6d1b-4a48-85cf-4a4e0c5409df tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Returning 404 to user: Instance 0c199bd9-ce9c-4761-9f84-042971621d9c could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:03:30.429527 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d84980ed-6d1b-4a48-85cf-4a4e0c5409df tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 404 len: 111 microversion: 2.1 time: 0.036965 May 25 15:03:30.429527 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 343/698] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:03:30 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:03:30.437014 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-1534541b-eb44-4ce4-ba90-d51960a96b06 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '.version_select at 0x7fb1e418e310>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:30.455741 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-1534541b-eb44-4ce4-ba90-d51960a96b06 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-983056680" status: 202 len: 0 microversion: 2.1 time: 0.025017 May 25 15:03:30.456251 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 356/699] 10.222.0.78 () {58 vars in 1217 bytes} [Wed May 25 15:03:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-983056680 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 15:03:33.354120 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6af41390-b228-47d1-999b-80c1d5453bc8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:33.354612 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6af41390-b228-47d1-999b-80c1d5453bc8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:33.361437 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6af41390-b228-47d1-999b-80c1d5453bc8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:33.361884 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6af41390-b228-47d1-999b-80c1d5453bc8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:33.362668 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6af41390-b228-47d1-999b-80c1d5453bc8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:33.363092 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6af41390-b228-47d1-999b-80c1d5453bc8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:33.376573 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-6af41390-b228-47d1-999b-80c1d5453bc8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] HTTP exception thrown: Instance 0c199bd9-ce9c-4761-9f84-042971621d9c could not be found. May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6af41390-b228-47d1-999b-80c1d5453bc8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Request method failure captured: May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: DELETE /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c HTTP/1.1 May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkOMGxLp5La0duucSziDTnmPb4MU3_K5UmVHkmMTzOrKf4CDiWgoAAMnWidsfANdWM6N22uaVZw8H4Gi4s6gZps3-l9ke1k9LwV8gtAhQi1hEe9iYagGpPwWa0uPizubIvmE_UQXOMQcsRQ7l6vRyCvGnhYjwCuJur35xzymhn2liVU May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 2395f31fad3645c19096d648c521bf31 May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-AttachVolumeTestJSON-925279656 May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:03:33.378172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:03:33.379735 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2395f31fad3645c19096d648c521bf31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2395f31fad3645c19096d648c521bf31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2395f31fad3645c19096d648c521bf31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2395f31fad3645c19096d648c521bf31"}]}] May 25 15:03:33.379735 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-AttachVolumeTestJSON-925279656 May 25 15:03:33.379735 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 2395f31fad3645c19096d648c521bf31 May 25 15:03:33.379735 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-AttachVolumeTestJSON-925279656 May 25 15:03:33.379735 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-AttachVolumeTestJSON-925279656-project May 25 15:03:33.379735 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:03:33.379735 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:03:33.379735 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: 7fedb9b92e9a4e3cb671f69751e426a1 May 25 15:03:33.379735 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-AttachVolumeTestJSON-925279656-project May 25 15:03:33.379735 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:03:33.379735 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance 0c199bd9-ce9c-4761-9f84-042971621d9c could not be found. May 25 15:03:33.379735 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': '0c199bd9-ce9c-4761-9f84-042971621d9c'} May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c199bd9-ce9c-4761-9f84-042971621d9c could not be found. May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:03:33.380633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c199bd9-ce9c-4761-9f84-042971621d9c could not be found. May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c199bd9-ce9c-4761-9f84-042971621d9c could not be found. May 25 15:03:33.382146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:03:33.384234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6af41390-b228-47d1-999b-80c1d5453bc8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Returning 404 to user: Instance 0c199bd9-ce9c-4761-9f84-042971621d9c could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:03:33.384234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6af41390-b228-47d1-999b-80c1d5453bc8 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 404 len: 111 microversion: 2.1 time: 0.029267 May 25 15:03:33.384234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 344/700] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:03:33 2022] DELETE /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:03:33.389283 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-537d0d3c-3c04-4801-add9-424522074299 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:33.389923 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-537d0d3c-3c04-4801-add9-424522074299 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 0c199bd9-ce9c-4761-9f84-042971621d9c] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:33.396901 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-537d0d3c-3c04-4801-add9-424522074299 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:33.397158 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-537d0d3c-3c04-4801-add9-424522074299 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:33.398168 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-537d0d3c-3c04-4801-add9-424522074299 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:33.398406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-537d0d3c-3c04-4801-add9-424522074299 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:33.412313 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-537d0d3c-3c04-4801-add9-424522074299 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] HTTP exception thrown: Instance 0c199bd9-ce9c-4761-9f84-042971621d9c could not be found. May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-537d0d3c-3c04-4801-add9-424522074299 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Request method failure captured: May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c HTTP/1.1 May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkOMGxLp5La0duucSziDTnmPb4MU3_K5UmVHkmMTzOrKf4CDiWgoAAMnWidsfANdWM6N22uaVZw8H4Gi4s6gZps3-l9ke1k9LwV8gtAhQi1hEe9iYagGpPwWa0uPizubIvmE_UQXOMQcsRQ7l6vRyCvGnhYjwCuJur35xzymhn2liVU May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 2395f31fad3645c19096d648c521bf31 May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-AttachVolumeTestJSON-925279656 May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:03:33.413949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:03:33.415524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2395f31fad3645c19096d648c521bf31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2395f31fad3645c19096d648c521bf31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2395f31fad3645c19096d648c521bf31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2395f31fad3645c19096d648c521bf31"}]}] May 25 15:03:33.415524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-AttachVolumeTestJSON-925279656 May 25 15:03:33.415524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 2395f31fad3645c19096d648c521bf31 May 25 15:03:33.415524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-AttachVolumeTestJSON-925279656 May 25 15:03:33.415524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-AttachVolumeTestJSON-925279656-project May 25 15:03:33.415524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:03:33.415524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:03:33.415524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: 7fedb9b92e9a4e3cb671f69751e426a1 May 25 15:03:33.415524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-AttachVolumeTestJSON-925279656-project May 25 15:03:33.415524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:03:33.415524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance 0c199bd9-ce9c-4761-9f84-042971621d9c could not be found. May 25 15:03:33.415524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': '0c199bd9-ce9c-4761-9f84-042971621d9c'} May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c199bd9-ce9c-4761-9f84-042971621d9c could not be found. May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:03:33.416340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:03:33.417531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:03:33.417531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:03:33.417531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:03:33.417531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:03:33.417531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:03:33.417531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:03:33.417531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:03:33.417531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c199bd9-ce9c-4761-9f84-042971621d9c could not be found. May 25 15:03:33.417531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:03:33.417531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:03:33.417531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:03:33.417531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:33.417531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:03:33.417531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:03:33.417531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:03:33.417531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:03:33.417531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c199bd9-ce9c-4761-9f84-042971621d9c could not be found. May 25 15:03:33.417531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:03:33.418628 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-537d0d3c-3c04-4801-add9-424522074299 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Returning 404 to user: Instance 0c199bd9-ce9c-4761-9f84-042971621d9c could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:03:33.418628 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-537d0d3c-3c04-4801-add9-424522074299 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c" status: 404 len: 111 microversion: 2.1 time: 0.030971 May 25 15:03:33.418628 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 357/701] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:03:33 2022] GET /compute/v2.1/servers/0c199bd9-ce9c-4761-9f84-042971621d9c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:03:34.548610 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8d9f2140-4d61-4aa8-aa5e-7428c1587319 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:34.549111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-8d9f2140-4d61-4aa8-aa5e-7428c1587319 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:34.555693 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8d9f2140-4d61-4aa8-aa5e-7428c1587319 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:34.556141 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8d9f2140-4d61-4aa8-aa5e-7428c1587319 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:34.556905 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8d9f2140-4d61-4aa8-aa5e-7428c1587319 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:34.557346 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8d9f2140-4d61-4aa8-aa5e-7428c1587319 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:34.571279 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-8d9f2140-4d61-4aa8-aa5e-7428c1587319 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] HTTP exception thrown: Instance 6be96576-0efd-4362-8e0d-f74b16ddc912 could not be found. May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8d9f2140-4d61-4aa8-aa5e-7428c1587319 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Request method failure captured: May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: DELETE /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 HTTP/1.1 May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkOMGxLp5La0duucSziDTnmPb4MU3_K5UmVHkmMTzOrKf4CDiWgoAAMnWidsfANdWM6N22uaVZw8H4Gi4s6gZps3-l9ke1k9LwV8gtAhQi1hEe9iYagGpPwWa0uPizubIvmE_UQXOMQcsRQ7l6vRyCvGnhYjwCuJur35xzymhn2liVU May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 2395f31fad3645c19096d648c521bf31 May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-AttachVolumeTestJSON-925279656 May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:03:34.572846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:03:34.574438 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2395f31fad3645c19096d648c521bf31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2395f31fad3645c19096d648c521bf31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2395f31fad3645c19096d648c521bf31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2395f31fad3645c19096d648c521bf31"}]}] May 25 15:03:34.574438 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-AttachVolumeTestJSON-925279656 May 25 15:03:34.574438 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 2395f31fad3645c19096d648c521bf31 May 25 15:03:34.574438 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-AttachVolumeTestJSON-925279656 May 25 15:03:34.574438 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-AttachVolumeTestJSON-925279656-project May 25 15:03:34.574438 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:03:34.574438 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:03:34.574438 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: 7fedb9b92e9a4e3cb671f69751e426a1 May 25 15:03:34.574438 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-AttachVolumeTestJSON-925279656-project May 25 15:03:34.574438 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:03:34.574438 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance 6be96576-0efd-4362-8e0d-f74b16ddc912 could not be found. May 25 15:03:34.574438 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': '6be96576-0efd-4362-8e0d-f74b16ddc912'} May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be96576-0efd-4362-8e0d-f74b16ddc912 could not be found. May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:03:34.575290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be96576-0efd-4362-8e0d-f74b16ddc912 could not be found. May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be96576-0efd-4362-8e0d-f74b16ddc912 could not be found. May 25 15:03:34.577538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:03:34.579176 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8d9f2140-4d61-4aa8-aa5e-7428c1587319 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Returning 404 to user: Instance 6be96576-0efd-4362-8e0d-f74b16ddc912 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:03:34.579176 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-8d9f2140-4d61-4aa8-aa5e-7428c1587319 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 404 len: 111 microversion: 2.1 time: 0.029529 May 25 15:03:34.579176 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 345/702] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:03:34 2022] DELETE /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:03:34.583176 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-950e67fb-e44c-44c9-a5bf-c1bec2ed0106 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:34.583935 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-950e67fb-e44c-44c9-a5bf-c1bec2ed0106 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] [instance: 6be96576-0efd-4362-8e0d-f74b16ddc912] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:34.592158 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-950e67fb-e44c-44c9-a5bf-c1bec2ed0106 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:34.592608 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-950e67fb-e44c-44c9-a5bf-c1bec2ed0106 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:34.593389 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-950e67fb-e44c-44c9-a5bf-c1bec2ed0106 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:34.593856 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-950e67fb-e44c-44c9-a5bf-c1bec2ed0106 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:34.610381 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-950e67fb-e44c-44c9-a5bf-c1bec2ed0106 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] HTTP exception thrown: Instance 6be96576-0efd-4362-8e0d-f74b16ddc912 could not be found. May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-950e67fb-e44c-44c9-a5bf-c1bec2ed0106 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Request method failure captured: May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 HTTP/1.1 May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkOMGxLp5La0duucSziDTnmPb4MU3_K5UmVHkmMTzOrKf4CDiWgoAAMnWidsfANdWM6N22uaVZw8H4Gi4s6gZps3-l9ke1k9LwV8gtAhQi1hEe9iYagGpPwWa0uPizubIvmE_UQXOMQcsRQ7l6vRyCvGnhYjwCuJur35xzymhn2liVU May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 2395f31fad3645c19096d648c521bf31 May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-AttachVolumeTestJSON-925279656 May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:03:34.612344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:03:34.613933 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2395f31fad3645c19096d648c521bf31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2395f31fad3645c19096d648c521bf31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2395f31fad3645c19096d648c521bf31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2395f31fad3645c19096d648c521bf31"}]}] May 25 15:03:34.613933 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-AttachVolumeTestJSON-925279656 May 25 15:03:34.613933 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 2395f31fad3645c19096d648c521bf31 May 25 15:03:34.613933 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-AttachVolumeTestJSON-925279656 May 25 15:03:34.613933 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-AttachVolumeTestJSON-925279656-project May 25 15:03:34.613933 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:03:34.613933 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:03:34.613933 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: 7fedb9b92e9a4e3cb671f69751e426a1 May 25 15:03:34.613933 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-AttachVolumeTestJSON-925279656-project May 25 15:03:34.613933 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:03:34.613933 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance 6be96576-0efd-4362-8e0d-f74b16ddc912 could not be found. May 25 15:03:34.613933 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': '6be96576-0efd-4362-8e0d-f74b16ddc912'} May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be96576-0efd-4362-8e0d-f74b16ddc912 could not be found. May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:03:34.615071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:03:34.616583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:03:34.616583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:03:34.616583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:03:34.616583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:03:34.616583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:03:34.616583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:03:34.616583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:03:34.616583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be96576-0efd-4362-8e0d-f74b16ddc912 could not be found. May 25 15:03:34.616583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:03:34.616583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:03:34.616583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:03:34.616583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:34.616583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:03:34.616583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:03:34.616583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:03:34.616583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:03:34.616583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be96576-0efd-4362-8e0d-f74b16ddc912 could not be found. May 25 15:03:34.616583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:03:34.617973 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-950e67fb-e44c-44c9-a5bf-c1bec2ed0106 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] Returning 404 to user: Instance 6be96576-0efd-4362-8e0d-f74b16ddc912 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:03:34.617973 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-950e67fb-e44c-44c9-a5bf-c1bec2ed0106 tempest-AttachVolumeTestJSON-925279656 tempest-AttachVolumeTestJSON-925279656-project] 10.222.0.78 "GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912" status: 404 len: 111 microversion: 2.1 time: 0.034431 May 25 15:03:34.617973 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 358/703] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:03:34 2022] GET /compute/v2.1/servers/6be96576-0efd-4362-8e0d-f74b16ddc912 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:03:54.105835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b72a4655-ce2d-4e79-9cef-8e3c4f10d6f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:54.106441 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b72a4655-ce2d-4e79-9cef-8e3c4f10d6f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:54.108944 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=21 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:54.109973 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:54.116493 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b72a4655-ce2d-4e79-9cef-8e3c4f10d6f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:54.116949 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b72a4655-ce2d-4e79-9cef-8e3c4f10d6f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:54.117721 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b72a4655-ce2d-4e79-9cef-8e3c4f10d6f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:54.118193 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b72a4655-ce2d-4e79-9cef-8e3c4f10d6f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:54.142788 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b72a4655-ce2d-4e79-9cef-8e3c4f10d6f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883/ips" status: 200 len: 148 microversion: 2.1 time: 0.040876 May 25 15:03:54.143357 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 346/704] 10.222.0.78 () {58 vars in 1247 bytes} [Wed May 25 15:03:54 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:55.513249 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-c995eb1d-e9e3-4a07-8de1-3f6ef9e1a716 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fc456e2-eaf2-4da2-ab37-7ed6a4f3579f"}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:03:55.514945 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-c995eb1d-e9e3-4a07-8de1-3f6ef9e1a716 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:55.517383 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:55.518078 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:55.526405 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c995eb1d-e9e3-4a07-8de1-3f6ef9e1a716 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:55.527017 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c995eb1d-e9e3-4a07-8de1-3f6ef9e1a716 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:55.527929 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c995eb1d-e9e3-4a07-8de1-3f6ef9e1a716 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:55.528370 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c995eb1d-e9e3-4a07-8de1-3f6ef9e1a716 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:55.829880 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-c995eb1d-e9e3-4a07-8de1-3f6ef9e1a716 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "POST /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321264 May 25 15:03:55.835673 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 359/705] 10.222.0.78 () {60 vars in 1322 bytes} [Wed May 25 15:03:55 2022] POST /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:04:04.544398 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-57a439de-0aff-4f69-a5c2-6fe222e90a48 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:04.544954 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-57a439de-0aff-4f69-a5c2-6fe222e90a48 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:04.547528 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:04.548269 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=4 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:04.553123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-57a439de-0aff-4f69-a5c2-6fe222e90a48 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:04.553564 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-57a439de-0aff-4f69-a5c2-6fe222e90a48 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:04.554364 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-57a439de-0aff-4f69-a5c2-6fe222e90a48 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:04.554795 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-57a439de-0aff-4f69-a5c2-6fe222e90a48 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:04.643429 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-57a439de-0aff-4f69-a5c2-6fe222e90a48 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lazy-loading 'services' on Instance uuid d08c7580-ff9d-4f6a-894b-ec2805b4f883 {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:04:04.719611 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-57a439de-0aff-4f69-a5c2-6fe222e90a48 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883/os-volume_attachments/0fc456e2-eaf2-4da2-ab37-7ed6a4f3579f" status: 202 len: 0 microversion: 2.1 time: 0.179155 May 25 15:04:04.720214 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 347/706] 10.222.0.78 () {58 vars in 1415 bytes} [Wed May 25 15:04:04 2022] DELETE /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883/os-volume_attachments/0fc456e2-eaf2-4da2-ab37-7ed6a4f3579f => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:04:04.730620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b810a0bf-6f01-4c68-9144-7ee1060e857b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:04.732440 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-b810a0bf-6f01-4c68-9144-7ee1060e857b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:04.739423 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b810a0bf-6f01-4c68-9144-7ee1060e857b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:04.739900 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b810a0bf-6f01-4c68-9144-7ee1060e857b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:04.740710 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b810a0bf-6f01-4c68-9144-7ee1060e857b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:04.741870 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b810a0bf-6f01-4c68-9144-7ee1060e857b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:04.772571 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-b810a0bf-6f01-4c68-9144-7ee1060e857b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046893 May 25 15:04:04.773141 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 360/707] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:04:04 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:04:05.785798 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-5d1f1b5f-c5d9-483c-bf8d-a6f8c7b66860 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:05.786956 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-5d1f1b5f-c5d9-483c-bf8d-a6f8c7b66860 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:05.793810 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5d1f1b5f-c5d9-483c-bf8d-a6f8c7b66860 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:05.794313 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5d1f1b5f-c5d9-483c-bf8d-a6f8c7b66860 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:05.795089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5d1f1b5f-c5d9-483c-bf8d-a6f8c7b66860 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:05.796103 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-5d1f1b5f-c5d9-483c-bf8d-a6f8c7b66860 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:05.825377 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-5d1f1b5f-c5d9-483c-bf8d-a6f8c7b66860 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043924 May 25 15:04:05.825942 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 348/708] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:04:05 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:04:06.837579 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a7b0fae2-15a0-4bc9-bdf8-01109ade2bb2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:06.838571 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a7b0fae2-15a0-4bc9-bdf8-01109ade2bb2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:06.845583 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a7b0fae2-15a0-4bc9-bdf8-01109ade2bb2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:06.846044 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a7b0fae2-15a0-4bc9-bdf8-01109ade2bb2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:06.846828 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a7b0fae2-15a0-4bc9-bdf8-01109ade2bb2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:06.847263 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a7b0fae2-15a0-4bc9-bdf8-01109ade2bb2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:06.878898 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a7b0fae2-15a0-4bc9-bdf8-01109ade2bb2 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045430 May 25 15:04:06.879509 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 361/709] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:04:06 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:04:06.943495 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-4b80dcfb-6ed3-4309-97c1-01045e8ad2a3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:06.944075 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-4b80dcfb-6ed3-4309-97c1-01045e8ad2a3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:06.950780 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4b80dcfb-6ed3-4309-97c1-01045e8ad2a3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:06.951221 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4b80dcfb-6ed3-4309-97c1-01045e8ad2a3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:06.952042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4b80dcfb-6ed3-4309-97c1-01045e8ad2a3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:06.952470 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4b80dcfb-6ed3-4309-97c1-01045e8ad2a3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:06.979492 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-4b80dcfb-6ed3-4309-97c1-01045e8ad2a3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Going to try to terminate instance {{(pid=124524) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:04:07.059246 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-4b80dcfb-6ed3-4309-97c1-01045e8ad2a3 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 204 len: 0 microversion: 2.1 time: 0.119325 May 25 15:04:07.060186 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 349/710] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:04:06 2022] DELETE /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:04:07.070186 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8778834e-63d7-49ca-beb0-5c88413df6ec tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:07.071003 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8778834e-63d7-49ca-beb0-5c88413df6ec tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:07.080267 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8778834e-63d7-49ca-beb0-5c88413df6ec tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:07.080893 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8778834e-63d7-49ca-beb0-5c88413df6ec tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:07.081773 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8778834e-63d7-49ca-beb0-5c88413df6ec tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:07.082244 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8778834e-63d7-49ca-beb0-5c88413df6ec tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:07.231736 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8778834e-63d7-49ca-beb0-5c88413df6ec tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:07.240434 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8778834e-63d7-49ca-beb0-5c88413df6ec tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 200 len: 1677 microversion: 2.1 time: 0.174332 May 25 15:04:07.241176 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 362/711] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:04:07 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:04:08.261471 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-aa740946-67f4-4467-ba7e-5308116aea5b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:08.262225 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-aa740946-67f4-4467-ba7e-5308116aea5b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:08.269790 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aa740946-67f4-4467-ba7e-5308116aea5b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:08.270260 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aa740946-67f4-4467-ba7e-5308116aea5b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:08.271098 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aa740946-67f4-4467-ba7e-5308116aea5b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:08.271529 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aa740946-67f4-4467-ba7e-5308116aea5b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:08.585172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-aa740946-67f4-4467-ba7e-5308116aea5b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:08.593092 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-aa740946-67f4-4467-ba7e-5308116aea5b tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 200 len: 1677 microversion: 2.1 time: 0.337279 May 25 15:04:08.593675 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 350/712] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:04:08 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 1677 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:09.612159 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-732a6ae3-c9da-4348-8e01-19fc1da4cf8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:09.612874 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-732a6ae3-c9da-4348-8e01-19fc1da4cf8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:09.619054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-732a6ae3-c9da-4348-8e01-19fc1da4cf8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:09.619499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-732a6ae3-c9da-4348-8e01-19fc1da4cf8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:09.620274 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-732a6ae3-c9da-4348-8e01-19fc1da4cf8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:09.620713 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-732a6ae3-c9da-4348-8e01-19fc1da4cf8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:09.853900 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-732a6ae3-c9da-4348-8e01-19fc1da4cf8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:09.862334 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-732a6ae3-c9da-4348-8e01-19fc1da4cf8e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 200 len: 1677 microversion: 2.1 time: 0.255035 May 25 15:04:09.862900 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 363/713] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:04:09 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 1677 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:04:10.553317 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-f519094d-7f5f-4103-8bd3-4edca548d330 req-20c28464-33dd-4915-8842-f650cb861818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d08c7580-ff9d-4f6a-894b-ec2805b4f883", "name": "network-vif-deleted", "tag": "abb2be77-3e38-420c-873c-fc5389d260f3"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:10.564356 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-f519094d-7f5f-4103-8bd3-4edca548d330 req-20c28464-33dd-4915-8842-f650cb861818 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:10.564802 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-f519094d-7f5f-4103-8bd3-4edca548d330 req-20c28464-33dd-4915-8842-f650cb861818 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:10.576558 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-f519094d-7f5f-4103-8bd3-4edca548d330 req-20c28464-33dd-4915-8842-f650cb861818 service nova] Creating event network-vif-deleted:abb2be77-3e38-420c-873c-fc5389d260f3 for instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 on hv-cinder-80382 May 25 15:04:10.582124 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-f519094d-7f5f-4103-8bd3-4edca548d330 req-20c28464-33dd-4915-8842-f650cb861818 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032298 May 25 15:04:10.582680 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 351/714] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:04:10.888184 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0352d109-b1bd-4001-94c8-c5f99cf9603f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:10.889673 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-0352d109-b1bd-4001-94c8-c5f99cf9603f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:10.901300 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0352d109-b1bd-4001-94c8-c5f99cf9603f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:10.901906 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0352d109-b1bd-4001-94c8-c5f99cf9603f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:10.902875 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0352d109-b1bd-4001-94c8-c5f99cf9603f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:10.903417 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0352d109-b1bd-4001-94c8-c5f99cf9603f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:10.946795 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0352d109-b1bd-4001-94c8-c5f99cf9603f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:10.947527 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0352d109-b1bd-4001-94c8-c5f99cf9603f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:10.948059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.objects.instance [None req-0352d109-b1bd-4001-94c8-c5f99cf9603f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lazy-loading 'fault' on Instance uuid d08c7580-ff9d-4f6a-894b-ec2805b4f883 {{(pid=124523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:04:10.997527 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-0352d109-b1bd-4001-94c8-c5f99cf9603f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60a5e751f22450c8e366c85b37af1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dafcd0df8524413b4fe81a0931323b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:11.006369 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-0352d109-b1bd-4001-94c8-c5f99cf9603f tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 200 len: 1328 microversion: 2.1 time: 0.129108 May 25 15:04:11.007327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 364/715] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:04:10 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 1328 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:12.002720 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-f7638445-2460-4fff-9bc6-175681e409a1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:12.003545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-f7638445-2460-4fff-9bc6-175681e409a1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:12.011734 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f7638445-2460-4fff-9bc6-175681e409a1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:12.012328 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f7638445-2460-4fff-9bc6-175681e409a1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:12.013344 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f7638445-2460-4fff-9bc6-175681e409a1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:12.013680 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f7638445-2460-4fff-9bc6-175681e409a1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:12.029256 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-37e52b6f-502d-46e6-95fd-b9dfd8f4e76e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:12.030539 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-37e52b6f-502d-46e6-95fd-b9dfd8f4e76e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:12.042980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-f7638445-2460-4fff-9bc6-175681e409a1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/ips" status: 200 len: 152 microversion: 2.20 time: 0.045768 May 25 15:04:12.043568 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 352/716] 10.222.0.78 () {60 vars in 1288 bytes} [Wed May 25 15:04:11 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/ips => generated 152 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:04:12.049569 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-37e52b6f-502d-46e6-95fd-b9dfd8f4e76e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:12.053939 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-37e52b6f-502d-46e6-95fd-b9dfd8f4e76e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:12.055526 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-37e52b6f-502d-46e6-95fd-b9dfd8f4e76e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:12.056339 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-37e52b6f-502d-46e6-95fd-b9dfd8f4e76e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:12.076204 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-37e52b6f-502d-46e6-95fd-b9dfd8f4e76e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] HTTP exception thrown: Instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 could not be found. May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-37e52b6f-502d-46e6-95fd-b9dfd8f4e76e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Request method failure captured: May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 HTTP/1.1 May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkOaNMspd4aouSbU1AbWPRZXQpnMIXaZVnqXM_GcJU5QANUYoykKOboFENZqE39ayR7YV98XzJEhmbNMT4xGE2Rmi1LhcZy3xlCFBJXF3aSJNrYEmDnN6WznzrHbbYABEJ1DEPcIqWV1-In6s7XLRv6-66f2Fc-5c9Wz9_np-VTpkmg May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:04:12.089751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:04:12.091550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}] May 25 15:04:12.091550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:12.091550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:04:12.091550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:12.091550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:04:12.091550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:04:12.091550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:04:12.091550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: e60a5e751f22450c8e366c85b37af1f6 May 25 15:04:12.091550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:04:12.091550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:04:12.091550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 could not be found. May 25 15:04:12.091550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': 'd08c7580-ff9d-4f6a-894b-ec2805b4f883'} May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 could not be found. May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:04:12.092988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:04:12.095498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:04:12.095498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:04:12.095498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:04:12.095498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:04:12.095498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:04:12.095498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:04:12.095498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:04:12.095498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 could not be found. May 25 15:04:12.095498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:12.095498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:12.095498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:12.095498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:12.095498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:12.095498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:12.095498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:04:12.095498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:04:12.095498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 could not be found. May 25 15:04:12.095498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:12.096636 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-37e52b6f-502d-46e6-95fd-b9dfd8f4e76e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Returning 404 to user: Instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:04:12.096636 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-37e52b6f-502d-46e6-95fd-b9dfd8f4e76e tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 404 len: 111 microversion: 2.1 time: 0.058028 May 25 15:04:12.096636 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 365/717] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:04:12 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:04:12.104039 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7ee55703-abd1-4d7a-80cf-e66151c33771 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '.version_select at 0x7fb1dad58c10>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:12.128167 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7ee55703-abd1-4d7a-80cf-e66151c33771 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-76811187" status: 202 len: 0 microversion: 2.1 time: 0.035000 May 25 15:04:12.129235 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 353/718] 10.222.0.78 () {58 vars in 1214 bytes} [Wed May 25 15:04:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-76811187 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:04:13.947064 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-365b4384-2c7d-402b-8bd2-34a4d1cb9783 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:13.947749 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-365b4384-2c7d-402b-8bd2-34a4d1cb9783 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:13.954671 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-365b4384-2c7d-402b-8bd2-34a4d1cb9783 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:13.955123 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-365b4384-2c7d-402b-8bd2-34a4d1cb9783 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:13.955902 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-365b4384-2c7d-402b-8bd2-34a4d1cb9783 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:13.956343 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-365b4384-2c7d-402b-8bd2-34a4d1cb9783 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:13.971572 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-365b4384-2c7d-402b-8bd2-34a4d1cb9783 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] HTTP exception thrown: Instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 could not be found. May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-365b4384-2c7d-402b-8bd2-34a4d1cb9783 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Request method failure captured: May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: DELETE /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 HTTP/1.1 May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkOaNMspd4aouSbU1AbWPRZXQpnMIXaZVnqXM_GcJU5QANUYoykKOboFENZqE39ayR7YV98XzJEhmbNMT4xGE2Rmi1LhcZy3xlCFBJXF3aSJNrYEmDnN6WznzrHbbYABEJ1DEPcIqWV1-In6s7XLRv6-66f2Fc-5c9Wz9_np-VTpkmg May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:04:13.973332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:04:13.975804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}] May 25 15:04:13.975804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:13.975804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:04:13.975804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:13.975804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:04:13.975804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:04:13.975804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:04:13.975804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: e60a5e751f22450c8e366c85b37af1f6 May 25 15:04:13.975804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:04:13.975804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:04:13.975804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 could not be found. May 25 15:04:13.975804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': 'd08c7580-ff9d-4f6a-894b-ec2805b4f883'} May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 could not be found. May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:04:13.976966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 could not be found. May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 could not be found. May 25 15:04:13.978495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:13.979929 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-365b4384-2c7d-402b-8bd2-34a4d1cb9783 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Returning 404 to user: Instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:04:13.979929 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-365b4384-2c7d-402b-8bd2-34a4d1cb9783 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 404 len: 111 microversion: 2.1 time: 0.032965 May 25 15:04:13.979929 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 366/719] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:04:13 2022] DELETE /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:04:13.988351 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-cdd0676b-7eee-4512-90a0-e9eebe005db4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:13.988966 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-cdd0676b-7eee-4512-90a0-e9eebe005db4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: d08c7580-ff9d-4f6a-894b-ec2805b4f883] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:13.996025 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cdd0676b-7eee-4512-90a0-e9eebe005db4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:13.996418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cdd0676b-7eee-4512-90a0-e9eebe005db4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:13.997604 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cdd0676b-7eee-4512-90a0-e9eebe005db4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:13.997874 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cdd0676b-7eee-4512-90a0-e9eebe005db4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:13.999129 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3e98163b-452e-49bb-ba45-7e3aeefc218d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:13.999787 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-3e98163b-452e-49bb-ba45-7e3aeefc218d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:14.007584 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3e98163b-452e-49bb-ba45-7e3aeefc218d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:14.007584 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3e98163b-452e-49bb-ba45-7e3aeefc218d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:14.007921 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3e98163b-452e-49bb-ba45-7e3aeefc218d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:14.008123 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3e98163b-452e-49bb-ba45-7e3aeefc218d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:14.014531 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-cdd0676b-7eee-4512-90a0-e9eebe005db4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] HTTP exception thrown: Instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 could not be found. May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-cdd0676b-7eee-4512-90a0-e9eebe005db4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Request method failure captured: May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 HTTP/1.1 May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkOaNMspd4aouSbU1AbWPRZXQpnMIXaZVnqXM_GcJU5QANUYoykKOboFENZqE39ayR7YV98XzJEhmbNMT4xGE2Rmi1LhcZy3xlCFBJXF3aSJNrYEmDnN6WznzrHbbYABEJ1DEPcIqWV1-In6s7XLRv6-66f2Fc-5c9Wz9_np-VTpkmg May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:04:14.016202 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:04:14.017549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}] May 25 15:04:14.017549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:14.017549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:04:14.017549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:14.017549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:04:14.017549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:04:14.017549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:04:14.017549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: e60a5e751f22450c8e366c85b37af1f6 May 25 15:04:14.017549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:04:14.017549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:04:14.017549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 could not be found. May 25 15:04:14.017549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': 'd08c7580-ff9d-4f6a-894b-ec2805b4f883'} May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 could not be found. May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:04:14.018500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:04:14.019947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:04:14.019947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:04:14.019947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:04:14.019947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:04:14.019947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:04:14.019947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:04:14.019947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:04:14.019947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 could not be found. May 25 15:04:14.019947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:14.019947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:14.019947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:14.019947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:14.019947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:14.019947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:14.019947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:04:14.019947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:04:14.019947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 could not be found. May 25 15:04:14.019947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:14.021258 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-cdd0676b-7eee-4512-90a0-e9eebe005db4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Returning 404 to user: Instance d08c7580-ff9d-4f6a-894b-ec2805b4f883 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:04:14.021258 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-cdd0676b-7eee-4512-90a0-e9eebe005db4 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883" status: 404 len: 111 microversion: 2.1 time: 0.033212 May 25 15:04:14.021491 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 354/720] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:04:13 2022] GET /compute/v2.1/servers/d08c7580-ff9d-4f6a-894b-ec2805b4f883 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:04:14.034981 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.objects.instance [None req-3e98163b-452e-49bb-ba45-7e3aeefc218d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lazy-loading 'flavor' on Instance uuid 879adce9-e352-4e39-b80b-dcaee814c084 {{(pid=124523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:04:14.373826 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3e98163b-452e-49bb-ba45-7e3aeefc218d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "POST /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/action" status: 202 len: 0 microversion: 2.20 time: 0.379501 May 25 15:04:14.374866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 367/721] 10.222.0.78 () {62 vars in 1318 bytes} [Wed May 25 15:04:13 2022] POST /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 15:04:14.384970 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-738c066a-c661-4c44-ad63-aae5d095bb65 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:14.385492 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-738c066a-c661-4c44-ad63-aae5d095bb65 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:14.392434 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-738c066a-c661-4c44-ad63-aae5d095bb65 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:14.392885 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-738c066a-c661-4c44-ad63-aae5d095bb65 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:14.393858 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-738c066a-c661-4c44-ad63-aae5d095bb65 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:14.394514 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-738c066a-c661-4c44-ad63-aae5d095bb65 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:14.550045 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-738c066a-c661-4c44-ad63-aae5d095bb65 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:14.558462 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-738c066a-c661-4c44-ad63-aae5d095bb65 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:14.559949 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-738c066a-c661-4c44-ad63-aae5d095bb65 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:14.561094 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-738c066a-c661-4c44-ad63-aae5d095bb65 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1724 microversion: 2.20 time: 0.181264 May 25 15:04:14.561632 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 355/722] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:14 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:15.580310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2a9e5fdb-9502-4884-a7f5-919bc026e817 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:15.581011 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2a9e5fdb-9502-4884-a7f5-919bc026e817 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:15.587667 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2a9e5fdb-9502-4884-a7f5-919bc026e817 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:15.588115 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2a9e5fdb-9502-4884-a7f5-919bc026e817 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:15.589570 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2a9e5fdb-9502-4884-a7f5-919bc026e817 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:15.589570 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2a9e5fdb-9502-4884-a7f5-919bc026e817 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:15.722166 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2a9e5fdb-9502-4884-a7f5-919bc026e817 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:15.730181 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2a9e5fdb-9502-4884-a7f5-919bc026e817 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:15.731713 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2a9e5fdb-9502-4884-a7f5-919bc026e817 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:15.733524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2a9e5fdb-9502-4884-a7f5-919bc026e817 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1724 microversion: 2.20 time: 0.157366 May 25 15:04:15.734137 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 368/723] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:15 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:16.751644 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-52b46894-53b5-4021-a831-8e1ec2fb31f0 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:16.752244 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-52b46894-53b5-4021-a831-8e1ec2fb31f0 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:16.759185 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-52b46894-53b5-4021-a831-8e1ec2fb31f0 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:16.759899 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-52b46894-53b5-4021-a831-8e1ec2fb31f0 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:16.760664 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-52b46894-53b5-4021-a831-8e1ec2fb31f0 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:16.761093 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-52b46894-53b5-4021-a831-8e1ec2fb31f0 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:16.893865 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-52b46894-53b5-4021-a831-8e1ec2fb31f0 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:16.902341 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-52b46894-53b5-4021-a831-8e1ec2fb31f0 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:16.903852 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-52b46894-53b5-4021-a831-8e1ec2fb31f0 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:16.905656 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-52b46894-53b5-4021-a831-8e1ec2fb31f0 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1724 microversion: 2.20 time: 0.157280 May 25 15:04:16.906236 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 356/724] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:16 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:17.924057 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3bea5f42-9346-479b-b19a-be22c05e3312 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:17.924662 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-3bea5f42-9346-479b-b19a-be22c05e3312 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:17.931501 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3bea5f42-9346-479b-b19a-be22c05e3312 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:17.931941 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3bea5f42-9346-479b-b19a-be22c05e3312 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:17.932709 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3bea5f42-9346-479b-b19a-be22c05e3312 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:17.933142 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3bea5f42-9346-479b-b19a-be22c05e3312 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:18.089584 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-3bea5f42-9346-479b-b19a-be22c05e3312 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:18.097860 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-3bea5f42-9346-479b-b19a-be22c05e3312 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:18.099388 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-3bea5f42-9346-479b-b19a-be22c05e3312 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:18.100554 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3bea5f42-9346-479b-b19a-be22c05e3312 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1724 microversion: 2.20 time: 0.180930 May 25 15:04:18.101110 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 369/725] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:17 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:18.352145 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a2300e5d-78bc-4516-92f0-c2fc5e7fea7c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:18.352145 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-a2300e5d-78bc-4516-92f0-c2fc5e7fea7c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:18.360521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a2300e5d-78bc-4516-92f0-c2fc5e7fea7c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:18.361216 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a2300e5d-78bc-4516-92f0-c2fc5e7fea7c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:18.362354 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a2300e5d-78bc-4516-92f0-c2fc5e7fea7c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:18.363909 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a2300e5d-78bc-4516-92f0-c2fc5e7fea7c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:18.379261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-a2300e5d-78bc-4516-92f0-c2fc5e7fea7c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] HTTP exception thrown: Instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 could not be found. May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a2300e5d-78bc-4516-92f0-c2fc5e7fea7c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Request method failure captured: May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: DELETE /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 HTTP/1.1 May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkOaNMspd4aouSbU1AbWPRZXQpnMIXaZVnqXM_GcJU5QANUYoykKOboFENZqE39ayR7YV98XzJEhmbNMT4xGE2Rmi1LhcZy3xlCFBJXF3aSJNrYEmDnN6WznzrHbbYABEJ1DEPcIqWV1-In6s7XLRv6-66f2Fc-5c9Wz9_np-VTpkmg May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:04:18.380911 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:04:18.382781 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}] May 25 15:04:18.382781 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:18.382781 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:04:18.382781 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:18.382781 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:04:18.382781 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:04:18.382781 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:04:18.382781 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: e60a5e751f22450c8e366c85b37af1f6 May 25 15:04:18.382781 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:04:18.382781 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:04:18.382781 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 could not be found. May 25 15:04:18.382781 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': '0cd834bb-ffdb-40c9-9585-cb81a52a3322'} May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 could not be found. May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:04:18.386926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 could not be found. May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 could not be found. May 25 15:04:18.388399 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:18.389837 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a2300e5d-78bc-4516-92f0-c2fc5e7fea7c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Returning 404 to user: Instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:04:18.389837 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-a2300e5d-78bc-4516-92f0-c2fc5e7fea7c tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 404 len: 111 microversion: 2.1 time: 0.037477 May 25 15:04:18.389837 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 357/726] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:04:18 2022] DELETE /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:04:18.398239 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0a7b9e51-9c02-4b5a-82f4-7ec46a734c22 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:18.401243 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-0a7b9e51-9c02-4b5a-82f4-7ec46a734c22 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 0cd834bb-ffdb-40c9-9585-cb81a52a3322] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:18.406775 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0a7b9e51-9c02-4b5a-82f4-7ec46a734c22 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:18.407227 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0a7b9e51-9c02-4b5a-82f4-7ec46a734c22 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:18.408001 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0a7b9e51-9c02-4b5a-82f4-7ec46a734c22 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:18.408432 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0a7b9e51-9c02-4b5a-82f4-7ec46a734c22 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:18.423235 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-0a7b9e51-9c02-4b5a-82f4-7ec46a734c22 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] HTTP exception thrown: Instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 could not be found. May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0a7b9e51-9c02-4b5a-82f4-7ec46a734c22 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Request method failure captured: May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 HTTP/1.1 May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkOaNMspd4aouSbU1AbWPRZXQpnMIXaZVnqXM_GcJU5QANUYoykKOboFENZqE39ayR7YV98XzJEhmbNMT4xGE2Rmi1LhcZy3xlCFBJXF3aSJNrYEmDnN6WznzrHbbYABEJ1DEPcIqWV1-In6s7XLRv6-66f2Fc-5c9Wz9_np-VTpkmg May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:04:18.424897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:04:18.427436 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}] May 25 15:04:18.427436 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:18.427436 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:04:18.427436 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:18.427436 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:04:18.427436 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:04:18.427436 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:04:18.427436 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: e60a5e751f22450c8e366c85b37af1f6 May 25 15:04:18.427436 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:04:18.427436 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:04:18.427436 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 could not be found. May 25 15:04:18.427436 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': '0cd834bb-ffdb-40c9-9585-cb81a52a3322'} May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 could not be found. May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:04:18.429069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:04:18.431734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:04:18.431734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:04:18.431734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:04:18.431734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:04:18.431734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:04:18.431734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:04:18.431734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:04:18.431734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 could not be found. May 25 15:04:18.431734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:18.431734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:18.431734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:18.431734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:18.431734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:18.431734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:18.431734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:04:18.431734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:04:18.431734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 could not be found. May 25 15:04:18.431734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:18.433550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0a7b9e51-9c02-4b5a-82f4-7ec46a734c22 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Returning 404 to user: Instance 0cd834bb-ffdb-40c9-9585-cb81a52a3322 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:04:18.433550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-0a7b9e51-9c02-4b5a-82f4-7ec46a734c22 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322" status: 404 len: 111 microversion: 2.1 time: 0.035473 May 25 15:04:18.433550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 370/727] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:04:18 2022] GET /compute/v2.1/servers/0cd834bb-ffdb-40c9-9585-cb81a52a3322 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:04:18.437252 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-fa3a65ef-3164-49cf-b237-a0347c93bd98 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:18.437806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-fa3a65ef-3164-49cf-b237-a0347c93bd98 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:18.444222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fa3a65ef-3164-49cf-b237-a0347c93bd98 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:18.444679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fa3a65ef-3164-49cf-b237-a0347c93bd98 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:18.445454 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fa3a65ef-3164-49cf-b237-a0347c93bd98 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:18.446324 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fa3a65ef-3164-49cf-b237-a0347c93bd98 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:18.460583 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-fa3a65ef-3164-49cf-b237-a0347c93bd98 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] HTTP exception thrown: Instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 could not be found. May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-fa3a65ef-3164-49cf-b237-a0347c93bd98 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Request method failure captured: May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: DELETE /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 HTTP/1.1 May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkOaNMspd4aouSbU1AbWPRZXQpnMIXaZVnqXM_GcJU5QANUYoykKOboFENZqE39ayR7YV98XzJEhmbNMT4xGE2Rmi1LhcZy3xlCFBJXF3aSJNrYEmDnN6WznzrHbbYABEJ1DEPcIqWV1-In6s7XLRv6-66f2Fc-5c9Wz9_np-VTpkmg May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:04:18.462194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:04:18.463756 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}] May 25 15:04:18.463756 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:18.463756 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:04:18.463756 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:18.463756 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:04:18.463756 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:04:18.463756 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:04:18.463756 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: e60a5e751f22450c8e366c85b37af1f6 May 25 15:04:18.463756 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:04:18.463756 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:04:18.463756 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 could not be found. May 25 15:04:18.463756 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': 'f150bd82-8a04-4a33-bebd-594f65f1d6a7'} May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 could not be found. May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:04:18.464603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 could not be found. May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 could not be found. May 25 15:04:18.466116 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:18.467427 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-fa3a65ef-3164-49cf-b237-a0347c93bd98 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Returning 404 to user: Instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:04:18.467427 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-fa3a65ef-3164-49cf-b237-a0347c93bd98 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 404 len: 111 microversion: 2.1 time: 0.032366 May 25 15:04:18.467427 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 358/728] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:04:18 2022] DELETE /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:04:18.473005 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a53ed9af-3e0e-4e04-bc80-ea41a27d0581 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:18.473657 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a53ed9af-3e0e-4e04-bc80-ea41a27d0581 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: f150bd82-8a04-4a33-bebd-594f65f1d6a7] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:18.480535 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a53ed9af-3e0e-4e04-bc80-ea41a27d0581 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:18.480986 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a53ed9af-3e0e-4e04-bc80-ea41a27d0581 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:18.481775 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a53ed9af-3e0e-4e04-bc80-ea41a27d0581 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:18.482254 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a53ed9af-3e0e-4e04-bc80-ea41a27d0581 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:18.497407 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-a53ed9af-3e0e-4e04-bc80-ea41a27d0581 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] HTTP exception thrown: Instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 could not be found. May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a53ed9af-3e0e-4e04-bc80-ea41a27d0581 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Request method failure captured: May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 HTTP/1.1 May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkOaNMspd4aouSbU1AbWPRZXQpnMIXaZVnqXM_GcJU5QANUYoykKOboFENZqE39ayR7YV98XzJEhmbNMT4xGE2Rmi1LhcZy3xlCFBJXF3aSJNrYEmDnN6WznzrHbbYABEJ1DEPcIqWV1-In6s7XLRv6-66f2Fc-5c9Wz9_np-VTpkmg May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:04:18.499654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:04:18.501257 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}] May 25 15:04:18.501257 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:18.501257 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:04:18.501257 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:18.501257 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:04:18.501257 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:04:18.501257 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:04:18.501257 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: e60a5e751f22450c8e366c85b37af1f6 May 25 15:04:18.501257 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:04:18.501257 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:04:18.501257 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 could not be found. May 25 15:04:18.501257 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': 'f150bd82-8a04-4a33-bebd-594f65f1d6a7'} May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 could not be found. May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:04:18.502086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:04:18.503576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:04:18.503576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:04:18.503576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:04:18.503576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:04:18.503576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:04:18.503576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:04:18.503576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:04:18.503576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 could not be found. May 25 15:04:18.503576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:18.503576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:18.503576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:18.503576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:18.503576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:18.503576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:18.503576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:04:18.503576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:04:18.503576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 could not be found. May 25 15:04:18.503576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:18.504830 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a53ed9af-3e0e-4e04-bc80-ea41a27d0581 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Returning 404 to user: Instance f150bd82-8a04-4a33-bebd-594f65f1d6a7 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:04:18.504830 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a53ed9af-3e0e-4e04-bc80-ea41a27d0581 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7" status: 404 len: 111 microversion: 2.1 time: 0.031990 May 25 15:04:18.504830 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 371/729] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:04:18 2022] GET /compute/v2.1/servers/f150bd82-8a04-4a33-bebd-594f65f1d6a7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:04:19.118773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7171f175-c6fa-4cdd-b2e9-2e22eae91084 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:19.119373 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7171f175-c6fa-4cdd-b2e9-2e22eae91084 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:19.127259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7171f175-c6fa-4cdd-b2e9-2e22eae91084 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:19.127839 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7171f175-c6fa-4cdd-b2e9-2e22eae91084 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:19.128877 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7171f175-c6fa-4cdd-b2e9-2e22eae91084 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:19.129414 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7171f175-c6fa-4cdd-b2e9-2e22eae91084 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:19.267432 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7171f175-c6fa-4cdd-b2e9-2e22eae91084 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:19.275480 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7171f175-c6fa-4cdd-b2e9-2e22eae91084 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:19.276991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7171f175-c6fa-4cdd-b2e9-2e22eae91084 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:19.278183 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7171f175-c6fa-4cdd-b2e9-2e22eae91084 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1724 microversion: 2.20 time: 0.163525 May 25 15:04:19.278744 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 359/730] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:19 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:04:19.678648 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ad25453b-5188-40e9-ab57-ce2f282c1c04 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:19.679156 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ad25453b-5188-40e9-ab57-ce2f282c1c04 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:19.685896 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ad25453b-5188-40e9-ab57-ce2f282c1c04 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:19.687055 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ad25453b-5188-40e9-ab57-ce2f282c1c04 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:19.687823 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ad25453b-5188-40e9-ab57-ce2f282c1c04 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:19.688287 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ad25453b-5188-40e9-ab57-ce2f282c1c04 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:19.701831 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-ad25453b-5188-40e9-ab57-ce2f282c1c04 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] HTTP exception thrown: Instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 could not be found. May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ad25453b-5188-40e9-ab57-ce2f282c1c04 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Request method failure captured: May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: DELETE /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 HTTP/1.1 May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkOaNMspd4aouSbU1AbWPRZXQpnMIXaZVnqXM_GcJU5QANUYoykKOboFENZqE39ayR7YV98XzJEhmbNMT4xGE2Rmi1LhcZy3xlCFBJXF3aSJNrYEmDnN6WznzrHbbYABEJ1DEPcIqWV1-In6s7XLRv6-66f2Fc-5c9Wz9_np-VTpkmg May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:04:19.703406 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:04:19.704799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}] May 25 15:04:19.704799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:19.704799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:04:19.704799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:19.704799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:04:19.704799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:04:19.704799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:04:19.704799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: e60a5e751f22450c8e366c85b37af1f6 May 25 15:04:19.704799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:04:19.704799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:04:19.704799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 could not be found. May 25 15:04:19.704799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': '70a0babe-e62d-4dd3-8642-7c049a6236a3'} May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 could not be found. May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:04:19.706378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 could not be found. May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 could not be found. May 25 15:04:19.710638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:04:19.711836 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ad25453b-5188-40e9-ab57-ce2f282c1c04 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Returning 404 to user: Instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:04:19.711836 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ad25453b-5188-40e9-ab57-ce2f282c1c04 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "DELETE /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 404 len: 111 microversion: 2.1 time: 0.030026 May 25 15:04:19.711836 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 372/731] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:04:19 2022] DELETE /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:04:19.713278 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-60269646-01a9-4f0b-9ca6-f52b4d84a8f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:19.713918 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-60269646-01a9-4f0b-9ca6-f52b4d84a8f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] [instance: 70a0babe-e62d-4dd3-8642-7c049a6236a3] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:19.720775 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-60269646-01a9-4f0b-9ca6-f52b4d84a8f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:19.721222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-60269646-01a9-4f0b-9ca6-f52b4d84a8f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:19.721994 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-60269646-01a9-4f0b-9ca6-f52b4d84a8f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:19.722458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-60269646-01a9-4f0b-9ca6-f52b4d84a8f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:19.736836 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-60269646-01a9-4f0b-9ca6-f52b4d84a8f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] HTTP exception thrown: Instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 could not be found. May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-60269646-01a9-4f0b-9ca6-f52b4d84a8f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Request method failure captured: May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 HTTP/1.1 May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkOaNMspd4aouSbU1AbWPRZXQpnMIXaZVnqXM_GcJU5QANUYoykKOboFENZqE39ayR7YV98XzJEhmbNMT4xGE2Rmi1LhcZy3xlCFBJXF3aSJNrYEmDnN6WznzrHbbYABEJ1DEPcIqWV1-In6s7XLRv6-66f2Fc-5c9Wz9_np-VTpkmg May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:04:19.738410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:04:19.740384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dafcd0df8524413b4fe81a0931323b1"}]}] May 25 15:04:19.740384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:19.740384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 9dafcd0df8524413b4fe81a0931323b1 May 25 15:04:19.740384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533430010 May 25 15:04:19.740384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:04:19.740384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:04:19.740384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:04:19.740384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: e60a5e751f22450c8e366c85b37af1f6 May 25 15:04:19.740384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-AttachVolumeNegativeTest-533430010-project May 25 15:04:19.740384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:04:19.740384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 could not be found. May 25 15:04:19.740384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': '70a0babe-e62d-4dd3-8642-7c049a6236a3'} May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 could not be found. May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:04:19.741174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:04:19.742458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:04:19.742458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:04:19.742458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:04:19.742458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:04:19.742458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:04:19.742458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:04:19.742458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:04:19.742458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 could not be found. May 25 15:04:19.742458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:19.742458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:19.742458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:19.742458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:19.742458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:19.742458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:19.742458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:04:19.742458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:04:19.742458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 could not be found. May 25 15:04:19.742458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:04:19.743635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-60269646-01a9-4f0b-9ca6-f52b4d84a8f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] Returning 404 to user: Instance 70a0babe-e62d-4dd3-8642-7c049a6236a3 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:04:19.743635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-60269646-01a9-4f0b-9ca6-f52b4d84a8f5 tempest-AttachVolumeNegativeTest-533430010 tempest-AttachVolumeNegativeTest-533430010-project] 10.222.0.78 "GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3" status: 404 len: 111 microversion: 2.1 time: 0.030363 May 25 15:04:19.743635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 360/732] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:04:19 2022] GET /compute/v2.1/servers/70a0babe-e62d-4dd3-8642-7c049a6236a3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:04:20.297468 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-cd69aa2b-a70f-466d-abd1-86efdbc1398d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:20.298111 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-cd69aa2b-a70f-466d-abd1-86efdbc1398d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:20.304120 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cd69aa2b-a70f-466d-abd1-86efdbc1398d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:20.304572 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cd69aa2b-a70f-466d-abd1-86efdbc1398d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:20.305343 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cd69aa2b-a70f-466d-abd1-86efdbc1398d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:20.305776 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cd69aa2b-a70f-466d-abd1-86efdbc1398d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:20.466048 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-cd69aa2b-a70f-466d-abd1-86efdbc1398d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:20.475268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-cd69aa2b-a70f-466d-abd1-86efdbc1398d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:20.476745 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-cd69aa2b-a70f-466d-abd1-86efdbc1398d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:20.477971 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-cd69aa2b-a70f-466d-abd1-86efdbc1398d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1724 microversion: 2.20 time: 0.185163 May 25 15:04:20.478555 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 373/733] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:20 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:21.499327 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-eaa79afb-dc2b-4538-bd05-a053ffcb0b13 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:21.500257 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-eaa79afb-dc2b-4538-bd05-a053ffcb0b13 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:21.510603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-eaa79afb-dc2b-4538-bd05-a053ffcb0b13 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:21.511422 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-eaa79afb-dc2b-4538-bd05-a053ffcb0b13 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:21.512755 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-eaa79afb-dc2b-4538-bd05-a053ffcb0b13 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:21.513417 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-eaa79afb-dc2b-4538-bd05-a053ffcb0b13 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:21.754826 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-eaa79afb-dc2b-4538-bd05-a053ffcb0b13 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:21.766455 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-eaa79afb-dc2b-4538-bd05-a053ffcb0b13 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:21.769549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-eaa79afb-dc2b-4538-bd05-a053ffcb0b13 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:21.771006 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-eaa79afb-dc2b-4538-bd05-a053ffcb0b13 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1724 microversion: 2.20 time: 0.278508 May 25 15:04:21.782276 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 361/734] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:21 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:22.795508 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4b1421c0-80ea-4c8d-a1fc-00f2dbe91b94 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:22.797063 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4b1421c0-80ea-4c8d-a1fc-00f2dbe91b94 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:22.807916 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4b1421c0-80ea-4c8d-a1fc-00f2dbe91b94 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:22.808717 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4b1421c0-80ea-4c8d-a1fc-00f2dbe91b94 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:22.810536 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4b1421c0-80ea-4c8d-a1fc-00f2dbe91b94 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:22.811443 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4b1421c0-80ea-4c8d-a1fc-00f2dbe91b94 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:23.419170 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4b1421c0-80ea-4c8d-a1fc-00f2dbe91b94 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:23.428992 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4b1421c0-80ea-4c8d-a1fc-00f2dbe91b94 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:23.431387 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4b1421c0-80ea-4c8d-a1fc-00f2dbe91b94 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:23.433293 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4b1421c0-80ea-4c8d-a1fc-00f2dbe91b94 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1724 microversion: 2.20 time: 0.643706 May 25 15:04:23.434650 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 374/735] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:22 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1724 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:24.452833 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-3414343e-5968-41e6-9ba1-ff894fdc9ef3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:24.453614 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-3414343e-5968-41e6-9ba1-ff894fdc9ef3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:24.460398 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3414343e-5968-41e6-9ba1-ff894fdc9ef3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:24.461111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3414343e-5968-41e6-9ba1-ff894fdc9ef3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:24.462124 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3414343e-5968-41e6-9ba1-ff894fdc9ef3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:24.462722 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3414343e-5968-41e6-9ba1-ff894fdc9ef3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:24.621874 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3414343e-5968-41e6-9ba1-ff894fdc9ef3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:24.632805 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3414343e-5968-41e6-9ba1-ff894fdc9ef3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:24.635064 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3414343e-5968-41e6-9ba1-ff894fdc9ef3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:24.636238 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-3414343e-5968-41e6-9ba1-ff894fdc9ef3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1724 microversion: 2.20 time: 0.188411 May 25 15:04:24.636929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 362/736] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:24 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:25.653703 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0edd395f-35b5-47ec-8f59-72b1cd913bf1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:25.654347 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-0edd395f-35b5-47ec-8f59-72b1cd913bf1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:25.660712 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=35 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:25.662233 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0edd395f-35b5-47ec-8f59-72b1cd913bf1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:25.662686 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0edd395f-35b5-47ec-8f59-72b1cd913bf1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:25.663462 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0edd395f-35b5-47ec-8f59-72b1cd913bf1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:25.663900 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0edd395f-35b5-47ec-8f59-72b1cd913bf1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:25.668535 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:25.815881 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-0edd395f-35b5-47ec-8f59-72b1cd913bf1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:25.824044 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-0edd395f-35b5-47ec-8f59-72b1cd913bf1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:25.825551 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-0edd395f-35b5-47ec-8f59-72b1cd913bf1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:25.827548 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-0edd395f-35b5-47ec-8f59-72b1cd913bf1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1724 microversion: 2.20 time: 0.177817 May 25 15:04:25.828261 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 375/737] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:25 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:26.846171 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-9b6bfde7-0644-40ac-8737-d4c83c0818cb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:26.846943 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-9b6bfde7-0644-40ac-8737-d4c83c0818cb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:26.853647 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9b6bfde7-0644-40ac-8737-d4c83c0818cb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:26.854274 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9b6bfde7-0644-40ac-8737-d4c83c0818cb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:26.855157 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9b6bfde7-0644-40ac-8737-d4c83c0818cb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:26.855695 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9b6bfde7-0644-40ac-8737-d4c83c0818cb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:27.039397 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-9b6bfde7-0644-40ac-8737-d4c83c0818cb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:27.050426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-9b6bfde7-0644-40ac-8737-d4c83c0818cb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:27.052543 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-9b6bfde7-0644-40ac-8737-d4c83c0818cb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:27.053771 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-9b6bfde7-0644-40ac-8737-d4c83c0818cb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1724 microversion: 2.20 time: 0.212055 May 25 15:04:27.054539 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 363/738] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:26 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:28.072945 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ef0a245a-013a-453d-b9af-781e97793753 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:28.073576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ef0a245a-013a-453d-b9af-781e97793753 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:28.080893 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ef0a245a-013a-453d-b9af-781e97793753 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:28.081304 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ef0a245a-013a-453d-b9af-781e97793753 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:28.082103 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ef0a245a-013a-453d-b9af-781e97793753 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:28.082538 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ef0a245a-013a-453d-b9af-781e97793753 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:28.215912 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ef0a245a-013a-453d-b9af-781e97793753 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:28.224069 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ef0a245a-013a-453d-b9af-781e97793753 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:28.225580 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ef0a245a-013a-453d-b9af-781e97793753 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:28.226778 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ef0a245a-013a-453d-b9af-781e97793753 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1724 microversion: 2.20 time: 0.157782 May 25 15:04:28.227335 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 376/739] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:28 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:04:29.244746 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-946bd7dc-6286-407c-9f5c-5e51bbdb2f9f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:29.245434 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-946bd7dc-6286-407c-9f5c-5e51bbdb2f9f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:29.257171 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-946bd7dc-6286-407c-9f5c-5e51bbdb2f9f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:29.257910 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-946bd7dc-6286-407c-9f5c-5e51bbdb2f9f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:29.259185 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-946bd7dc-6286-407c-9f5c-5e51bbdb2f9f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:29.260181 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-946bd7dc-6286-407c-9f5c-5e51bbdb2f9f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:29.445545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-946bd7dc-6286-407c-9f5c-5e51bbdb2f9f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:29.454253 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-946bd7dc-6286-407c-9f5c-5e51bbdb2f9f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:29.455765 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-946bd7dc-6286-407c-9f5c-5e51bbdb2f9f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:29.456962 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-946bd7dc-6286-407c-9f5c-5e51bbdb2f9f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1724 microversion: 2.20 time: 0.216225 May 25 15:04:29.457506 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 364/740] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:29 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:30.475820 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-65d91840-b5ac-4a82-b0ae-f4dd8e84277f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:30.476961 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-65d91840-b5ac-4a82-b0ae-f4dd8e84277f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:30.484286 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-65d91840-b5ac-4a82-b0ae-f4dd8e84277f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:30.484986 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-65d91840-b5ac-4a82-b0ae-f4dd8e84277f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:30.485886 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-65d91840-b5ac-4a82-b0ae-f4dd8e84277f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:30.486512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-65d91840-b5ac-4a82-b0ae-f4dd8e84277f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:30.689441 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-65d91840-b5ac-4a82-b0ae-f4dd8e84277f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:30.697697 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-65d91840-b5ac-4a82-b0ae-f4dd8e84277f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:30.699733 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-65d91840-b5ac-4a82-b0ae-f4dd8e84277f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:30.701081 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-65d91840-b5ac-4a82-b0ae-f4dd8e84277f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1724 microversion: 2.20 time: 0.229340 May 25 15:04:30.702231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 377/741] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:30 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:31.724096 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-aed48825-9f29-4253-84e1-415c67d005c8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:31.724852 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-aed48825-9f29-4253-84e1-415c67d005c8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:31.732680 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aed48825-9f29-4253-84e1-415c67d005c8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:31.733134 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aed48825-9f29-4253-84e1-415c67d005c8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:31.734031 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aed48825-9f29-4253-84e1-415c67d005c8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:31.734495 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aed48825-9f29-4253-84e1-415c67d005c8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:31.883272 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-aed48825-9f29-4253-84e1-415c67d005c8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:31.887129 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:31.895118 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-aed48825-9f29-4253-84e1-415c67d005c8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:31.896881 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-aed48825-9f29-4253-84e1-415c67d005c8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:31.898107 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-aed48825-9f29-4253-84e1-415c67d005c8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1724 microversion: 2.20 time: 0.178322 May 25 15:04:31.898661 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 365/742] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:31 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:32.917500 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-66b4e6c2-44ed-48e2-913c-98ddaa49cc23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:32.919047 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-66b4e6c2-44ed-48e2-913c-98ddaa49cc23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:32.926482 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-66b4e6c2-44ed-48e2-913c-98ddaa49cc23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:32.927381 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-66b4e6c2-44ed-48e2-913c-98ddaa49cc23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:32.928653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-66b4e6c2-44ed-48e2-913c-98ddaa49cc23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:32.929314 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-66b4e6c2-44ed-48e2-913c-98ddaa49cc23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:33.088798 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-66b4e6c2-44ed-48e2-913c-98ddaa49cc23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:33.099151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-66b4e6c2-44ed-48e2-913c-98ddaa49cc23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:33.100616 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-66b4e6c2-44ed-48e2-913c-98ddaa49cc23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:33.101953 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-66b4e6c2-44ed-48e2-913c-98ddaa49cc23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1745 microversion: 2.20 time: 0.189005 May 25 15:04:33.102362 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 378/743] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:32 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:34.121576 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7f6eea4a-b049-4aac-83c5-d616f88df1b4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:34.122234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7f6eea4a-b049-4aac-83c5-d616f88df1b4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:34.131049 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7f6eea4a-b049-4aac-83c5-d616f88df1b4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:34.131502 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7f6eea4a-b049-4aac-83c5-d616f88df1b4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:34.132293 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7f6eea4a-b049-4aac-83c5-d616f88df1b4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:34.132731 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7f6eea4a-b049-4aac-83c5-d616f88df1b4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:34.281836 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7f6eea4a-b049-4aac-83c5-d616f88df1b4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:34.290894 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7f6eea4a-b049-4aac-83c5-d616f88df1b4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:34.292450 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7f6eea4a-b049-4aac-83c5-d616f88df1b4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:34.293618 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7f6eea4a-b049-4aac-83c5-d616f88df1b4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1745 microversion: 2.20 time: 0.176487 May 25 15:04:34.297480 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 366/744] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:34 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:35.316863 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d298ced3-be33-4599-b464-1373c68ce5aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:35.317881 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d298ced3-be33-4599-b464-1373c68ce5aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:35.324136 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d298ced3-be33-4599-b464-1373c68ce5aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:35.324576 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d298ced3-be33-4599-b464-1373c68ce5aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:35.325346 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d298ced3-be33-4599-b464-1373c68ce5aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:35.325777 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d298ced3-be33-4599-b464-1373c68ce5aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:35.457673 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d298ced3-be33-4599-b464-1373c68ce5aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:35.466627 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d298ced3-be33-4599-b464-1373c68ce5aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:35.468376 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d298ced3-be33-4599-b464-1373c68ce5aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:35.469953 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d298ced3-be33-4599-b464-1373c68ce5aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1745 microversion: 2.20 time: 0.157098 May 25 15:04:35.479240 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 379/745] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:35 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:36.490309 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-497bc145-5a08-42ea-97d4-00aa2314a541 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:36.491805 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-497bc145-5a08-42ea-97d4-00aa2314a541 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:36.511215 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:36.515374 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-497bc145-5a08-42ea-97d4-00aa2314a541 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:36.515846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-497bc145-5a08-42ea-97d4-00aa2314a541 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:36.516650 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-497bc145-5a08-42ea-97d4-00aa2314a541 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:36.517088 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-497bc145-5a08-42ea-97d4-00aa2314a541 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:36.713275 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-497bc145-5a08-42ea-97d4-00aa2314a541 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:36.732471 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-497bc145-5a08-42ea-97d4-00aa2314a541 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:36.739814 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-497bc145-5a08-42ea-97d4-00aa2314a541 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:36.741842 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-497bc145-5a08-42ea-97d4-00aa2314a541 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1740 microversion: 2.20 time: 0.256132 May 25 15:04:36.745292 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 367/746] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:36 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1740 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:37.188443 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-c2ee1a2c-790e-4053-9aaf-86164a3058ef req-db394034-f098-4ed8-865e-e115e1a4cf45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879adce9-e352-4e39-b80b-dcaee814c084", "name": "network-vif-plugged", "status": "completed", "tag": "1f402e27-3709-41db-8b59-49501ea83eb5"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:37.199222 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-c2ee1a2c-790e-4053-9aaf-86164a3058ef req-db394034-f098-4ed8-865e-e115e1a4cf45 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:37.199667 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-c2ee1a2c-790e-4053-9aaf-86164a3058ef req-db394034-f098-4ed8-865e-e115e1a4cf45 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:37.230367 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-c2ee1a2c-790e-4053-9aaf-86164a3058ef req-db394034-f098-4ed8-865e-e115e1a4cf45 service nova] Creating event network-vif-plugged:1f402e27-3709-41db-8b59-49501ea83eb5 for instance 879adce9-e352-4e39-b80b-dcaee814c084 on hv-cinder-80382 May 25 15:04:37.239058 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-c2ee1a2c-790e-4053-9aaf-86164a3058ef req-db394034-f098-4ed8-865e-e115e1a4cf45 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054339 May 25 15:04:37.239676 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 380/747] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:04:37.763573 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2682805e-c224-41cd-9015-8f7b141e7f83 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:37.764750 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2682805e-c224-41cd-9015-8f7b141e7f83 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:37.773988 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2682805e-c224-41cd-9015-8f7b141e7f83 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:37.773988 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2682805e-c224-41cd-9015-8f7b141e7f83 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:37.774819 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2682805e-c224-41cd-9015-8f7b141e7f83 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:37.775446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2682805e-c224-41cd-9015-8f7b141e7f83 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:38.006335 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-2682805e-c224-41cd-9015-8f7b141e7f83 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:38.015686 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-2682805e-c224-41cd-9015-8f7b141e7f83 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:38.025526 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-2682805e-c224-41cd-9015-8f7b141e7f83 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:38.027273 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2682805e-c224-41cd-9015-8f7b141e7f83 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1740 microversion: 2.20 time: 0.267974 May 25 15:04:38.028103 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 368/748] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:37 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:39.049771 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-c87640c8-90b7-4f5c-bad7-4e9f8d5a4060 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:39.050960 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-c87640c8-90b7-4f5c-bad7-4e9f8d5a4060 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:39.059708 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c87640c8-90b7-4f5c-bad7-4e9f8d5a4060 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:39.060243 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c87640c8-90b7-4f5c-bad7-4e9f8d5a4060 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:39.061416 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c87640c8-90b7-4f5c-bad7-4e9f8d5a4060 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:39.061927 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c87640c8-90b7-4f5c-bad7-4e9f8d5a4060 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:39.279501 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-c87640c8-90b7-4f5c-bad7-4e9f8d5a4060 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:39.290094 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-c87640c8-90b7-4f5c-bad7-4e9f8d5a4060 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:39.292364 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-c87640c8-90b7-4f5c-bad7-4e9f8d5a4060 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:39.293914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-c87640c8-90b7-4f5c-bad7-4e9f8d5a4060 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1740 microversion: 2.20 time: 0.250497 May 25 15:04:39.298777 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 381/749] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:39 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1740 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:40.323158 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0146c728-1585-4d8a-8f6a-2e0798ae8890 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:40.323957 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0146c728-1585-4d8a-8f6a-2e0798ae8890 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:40.341398 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0146c728-1585-4d8a-8f6a-2e0798ae8890 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:40.342575 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0146c728-1585-4d8a-8f6a-2e0798ae8890 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:40.343681 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0146c728-1585-4d8a-8f6a-2e0798ae8890 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:40.344265 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0146c728-1585-4d8a-8f6a-2e0798ae8890 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:40.558956 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-0146c728-1585-4d8a-8f6a-2e0798ae8890 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:40.571703 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-0146c728-1585-4d8a-8f6a-2e0798ae8890 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:40.574069 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-0146c728-1585-4d8a-8f6a-2e0798ae8890 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:40.575542 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0146c728-1585-4d8a-8f6a-2e0798ae8890 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1740 microversion: 2.20 time: 0.256385 May 25 15:04:40.576595 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 369/750] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:40 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1740 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:41.596031 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-fdbbe207-c9f9-49de-a7e9-a0684b658f3b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:41.597573 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-fdbbe207-c9f9-49de-a7e9-a0684b658f3b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:41.605064 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fdbbe207-c9f9-49de-a7e9-a0684b658f3b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:41.606308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fdbbe207-c9f9-49de-a7e9-a0684b658f3b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:41.607424 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fdbbe207-c9f9-49de-a7e9-a0684b658f3b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:41.608213 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fdbbe207-c9f9-49de-a7e9-a0684b658f3b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:41.782319 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-fdbbe207-c9f9-49de-a7e9-a0684b658f3b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:41.796111 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-fdbbe207-c9f9-49de-a7e9-a0684b658f3b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:41.802610 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-fdbbe207-c9f9-49de-a7e9-a0684b658f3b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:41.805946 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-fdbbe207-c9f9-49de-a7e9-a0684b658f3b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1740 microversion: 2.20 time: 0.215651 May 25 15:04:41.806630 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 382/751] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:41 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:42.825743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6b7db692-73ca-42bb-b0c9-b3919161510f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:42.827262 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6b7db692-73ca-42bb-b0c9-b3919161510f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:42.839218 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6b7db692-73ca-42bb-b0c9-b3919161510f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:42.839679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6b7db692-73ca-42bb-b0c9-b3919161510f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:42.840500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6b7db692-73ca-42bb-b0c9-b3919161510f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:42.840928 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6b7db692-73ca-42bb-b0c9-b3919161510f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:43.118139 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6b7db692-73ca-42bb-b0c9-b3919161510f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:43.130550 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6b7db692-73ca-42bb-b0c9-b3919161510f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:43.132215 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6b7db692-73ca-42bb-b0c9-b3919161510f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:43.133637 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6b7db692-73ca-42bb-b0c9-b3919161510f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1740 microversion: 2.20 time: 0.313025 May 25 15:04:43.145426 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 370/752] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:42 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1740 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:44.153373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-064f6b12-9939-4170-8a75-5adaa6c74ad2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:44.155275 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-064f6b12-9939-4170-8a75-5adaa6c74ad2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:44.167243 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-064f6b12-9939-4170-8a75-5adaa6c74ad2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:44.168070 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-064f6b12-9939-4170-8a75-5adaa6c74ad2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:44.169101 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-064f6b12-9939-4170-8a75-5adaa6c74ad2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:44.169775 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-064f6b12-9939-4170-8a75-5adaa6c74ad2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:44.329848 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-064f6b12-9939-4170-8a75-5adaa6c74ad2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:44.356572 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-064f6b12-9939-4170-8a75-5adaa6c74ad2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:44.359773 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-064f6b12-9939-4170-8a75-5adaa6c74ad2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:44.364828 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-064f6b12-9939-4170-8a75-5adaa6c74ad2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1740 microversion: 2.20 time: 0.216019 May 25 15:04:44.386994 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 383/753] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:44 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:45.393337 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-81a34035-33fe-412c-98ad-d63f53119e1c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:45.394582 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-81a34035-33fe-412c-98ad-d63f53119e1c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:45.403418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-81a34035-33fe-412c-98ad-d63f53119e1c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:45.403996 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-81a34035-33fe-412c-98ad-d63f53119e1c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:45.404949 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-81a34035-33fe-412c-98ad-d63f53119e1c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:45.406150 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-81a34035-33fe-412c-98ad-d63f53119e1c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:45.635565 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-81a34035-33fe-412c-98ad-d63f53119e1c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:45.645617 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-81a34035-33fe-412c-98ad-d63f53119e1c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:45.647722 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-81a34035-33fe-412c-98ad-d63f53119e1c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:45.649187 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-81a34035-33fe-412c-98ad-d63f53119e1c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1740 microversion: 2.20 time: 0.268524 May 25 15:04:45.650436 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 371/754] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:45 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1740 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:46.668750 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-13bcc210-794a-4e70-82b6-9418859eacb9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:46.669401 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-13bcc210-794a-4e70-82b6-9418859eacb9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:46.679204 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-13bcc210-794a-4e70-82b6-9418859eacb9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:46.680010 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-13bcc210-794a-4e70-82b6-9418859eacb9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:46.681067 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-13bcc210-794a-4e70-82b6-9418859eacb9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:46.681597 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-13bcc210-794a-4e70-82b6-9418859eacb9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:46.850987 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-13bcc210-794a-4e70-82b6-9418859eacb9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:46.857205 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-13bcc210-794a-4e70-82b6-9418859eacb9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:46.860083 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-13bcc210-794a-4e70-82b6-9418859eacb9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:46.861422 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-13bcc210-794a-4e70-82b6-9418859eacb9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1740 microversion: 2.20 time: 0.196836 May 25 15:04:46.872692 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 384/755] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:46 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:47.879984 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-54ba602a-85c5-478c-a760-476e166649a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:47.880721 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-54ba602a-85c5-478c-a760-476e166649a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:47.887798 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-54ba602a-85c5-478c-a760-476e166649a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:47.888327 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-54ba602a-85c5-478c-a760-476e166649a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:47.889109 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-54ba602a-85c5-478c-a760-476e166649a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:47.889549 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-54ba602a-85c5-478c-a760-476e166649a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:48.062747 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-54ba602a-85c5-478c-a760-476e166649a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:48.072422 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-54ba602a-85c5-478c-a760-476e166649a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:48.073949 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-54ba602a-85c5-478c-a760-476e166649a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:48.075158 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-54ba602a-85c5-478c-a760-476e166649a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1722 microversion: 2.20 time: 0.199381 May 25 15:04:48.076264 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 372/756] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:47 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:49.092789 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-6095d022-84cd-4795-a72f-dc2fa94cf0b6 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:49.093658 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-6095d022-84cd-4795-a72f-dc2fa94cf0b6 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:49.103565 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6095d022-84cd-4795-a72f-dc2fa94cf0b6 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:49.104516 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6095d022-84cd-4795-a72f-dc2fa94cf0b6 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:49.105718 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6095d022-84cd-4795-a72f-dc2fa94cf0b6 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:49.106407 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6095d022-84cd-4795-a72f-dc2fa94cf0b6 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:49.269494 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-6095d022-84cd-4795-a72f-dc2fa94cf0b6 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:49.280356 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-6095d022-84cd-4795-a72f-dc2fa94cf0b6 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:49.281906 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-6095d022-84cd-4795-a72f-dc2fa94cf0b6 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:49.283157 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-6095d022-84cd-4795-a72f-dc2fa94cf0b6 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1722 microversion: 2.20 time: 0.194261 May 25 15:04:49.283707 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 385/757] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:49 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:50.300906 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-ff624dab-0c45-46b3-a51a-f037664110e2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:50.301512 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-ff624dab-0c45-46b3-a51a-f037664110e2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:50.316655 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ff624dab-0c45-46b3-a51a-f037664110e2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:50.317311 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ff624dab-0c45-46b3-a51a-f037664110e2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:50.320184 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ff624dab-0c45-46b3-a51a-f037664110e2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:50.321417 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ff624dab-0c45-46b3-a51a-f037664110e2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:50.644683 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-ff624dab-0c45-46b3-a51a-f037664110e2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:50.652841 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-ff624dab-0c45-46b3-a51a-f037664110e2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:50.654781 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-ff624dab-0c45-46b3-a51a-f037664110e2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:50.656428 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-ff624dab-0c45-46b3-a51a-f037664110e2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1722 microversion: 2.20 time: 0.359302 May 25 15:04:50.667735 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 373/758] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:50 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:51.276694 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-a4bb9351-9aea-42ba-9a51-7b3fd0c5235d req-e80c4f73-c3bf-4593-9d97-c68f05f00cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879adce9-e352-4e39-b80b-dcaee814c084", "name": "network-vif-unplugged", "status": "completed", "tag": "1f402e27-3709-41db-8b59-49501ea83eb5"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:51.296941 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-a4bb9351-9aea-42ba-9a51-7b3fd0c5235d req-e80c4f73-c3bf-4593-9d97-c68f05f00cda service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:51.297398 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-a4bb9351-9aea-42ba-9a51-7b3fd0c5235d req-e80c4f73-c3bf-4593-9d97-c68f05f00cda service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:51.328851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-a4bb9351-9aea-42ba-9a51-7b3fd0c5235d req-e80c4f73-c3bf-4593-9d97-c68f05f00cda service nova] Creating event network-vif-unplugged:1f402e27-3709-41db-8b59-49501ea83eb5 for instance 879adce9-e352-4e39-b80b-dcaee814c084 on hv-cinder-80382 May 25 15:04:51.346249 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-a4bb9351-9aea-42ba-9a51-7b3fd0c5235d req-e80c4f73-c3bf-4593-9d97-c68f05f00cda service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067875 May 25 15:04:51.347768 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 386/759] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:04:51.675243 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-e25c8423-06b5-43d9-90ad-f68fc79ac208 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:51.675914 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-e25c8423-06b5-43d9-90ad-f68fc79ac208 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:51.682826 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e25c8423-06b5-43d9-90ad-f68fc79ac208 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:51.683276 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e25c8423-06b5-43d9-90ad-f68fc79ac208 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:51.684077 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e25c8423-06b5-43d9-90ad-f68fc79ac208 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:51.684509 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e25c8423-06b5-43d9-90ad-f68fc79ac208 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:52.180282 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-e25c8423-06b5-43d9-90ad-f68fc79ac208 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:52.195798 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-e25c8423-06b5-43d9-90ad-f68fc79ac208 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:52.214477 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-e25c8423-06b5-43d9-90ad-f68fc79ac208 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:52.215940 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-e25c8423-06b5-43d9-90ad-f68fc79ac208 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1665 microversion: 2.20 time: 0.544563 May 25 15:04:52.216685 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 374/760] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:51 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1665 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:52.238411 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-04f28c3d-c5ad-41ab-808b-7c5da1099c2b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1706b179-616e-4849-9797-4941e952855b"}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:52.240077 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-04f28c3d-c5ad-41ab-808b-7c5da1099c2b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:52.246747 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-04f28c3d-c5ad-41ab-808b-7c5da1099c2b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:52.247508 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-04f28c3d-c5ad-41ab-808b-7c5da1099c2b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:52.251840 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-04f28c3d-c5ad-41ab-808b-7c5da1099c2b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:52.252295 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-04f28c3d-c5ad-41ab-808b-7c5da1099c2b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:52.738732 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-04f28c3d-c5ad-41ab-808b-7c5da1099c2b tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "POST /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.505263 May 25 15:04:52.745783 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 387/761] 10.222.0.78 () {62 vars in 1363 bytes} [Wed May 25 15:04:52 2022] POST /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/os-volume_attachments => generated 188 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:04:52.973986 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-95c4ad23-dd5e-4a76-861b-3355d1d7bc2a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:52.974635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-95c4ad23-dd5e-4a76-861b-3355d1d7bc2a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:52.981008 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-95c4ad23-dd5e-4a76-861b-3355d1d7bc2a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:52.981458 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-95c4ad23-dd5e-4a76-861b-3355d1d7bc2a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:52.986378 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-95c4ad23-dd5e-4a76-861b-3355d1d7bc2a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:52.987069 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-95c4ad23-dd5e-4a76-861b-3355d1d7bc2a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:53.180023 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-95c4ad23-dd5e-4a76-861b-3355d1d7bc2a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "POST /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/action" status: 202 len: 0 microversion: 2.20 time: 0.210436 May 25 15:04:53.183975 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 375/762] 10.222.0.78 () {62 vars in 1318 bytes} [Wed May 25 15:04:52 2022] POST /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 15:04:53.192303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-5face5f7-96bd-4c95-bc3b-d93470cce02c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:53.192921 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-5face5f7-96bd-4c95-bc3b-d93470cce02c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:53.203949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5face5f7-96bd-4c95-bc3b-d93470cce02c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:53.204373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5face5f7-96bd-4c95-bc3b-d93470cce02c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:53.210375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5face5f7-96bd-4c95-bc3b-d93470cce02c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:53.214276 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5face5f7-96bd-4c95-bc3b-d93470cce02c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:53.637699 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5face5f7-96bd-4c95-bc3b-d93470cce02c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:53.651051 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5face5f7-96bd-4c95-bc3b-d93470cce02c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:53.663222 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5face5f7-96bd-4c95-bc3b-d93470cce02c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:53.664711 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-5face5f7-96bd-4c95-bc3b-d93470cce02c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1751 microversion: 2.20 time: 0.476351 May 25 15:04:53.676591 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 388/763] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:53 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1751 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:54.685055 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b15a95d4-96fc-463b-8ab1-5af5535ca40f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:54.685672 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b15a95d4-96fc-463b-8ab1-5af5535ca40f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:54.702130 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b15a95d4-96fc-463b-8ab1-5af5535ca40f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:54.702786 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b15a95d4-96fc-463b-8ab1-5af5535ca40f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:54.703623 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b15a95d4-96fc-463b-8ab1-5af5535ca40f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:54.704320 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b15a95d4-96fc-463b-8ab1-5af5535ca40f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:55.271396 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b15a95d4-96fc-463b-8ab1-5af5535ca40f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:55.290473 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b15a95d4-96fc-463b-8ab1-5af5535ca40f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:55.297438 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b15a95d4-96fc-463b-8ab1-5af5535ca40f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:55.298711 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b15a95d4-96fc-463b-8ab1-5af5535ca40f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1751 microversion: 2.20 time: 0.619078 May 25 15:04:55.299273 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 376/764] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:54 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1751 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:56.319834 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-148e7f49-041f-4e73-8827-e0af3aa1ecd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:56.321015 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-148e7f49-041f-4e73-8827-e0af3aa1ecd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:56.332839 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=28 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:56.338197 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-148e7f49-041f-4e73-8827-e0af3aa1ecd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:56.339342 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-148e7f49-041f-4e73-8827-e0af3aa1ecd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:56.340341 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-148e7f49-041f-4e73-8827-e0af3aa1ecd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:56.342816 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-148e7f49-041f-4e73-8827-e0af3aa1ecd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:56.354152 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:56.695866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-148e7f49-041f-4e73-8827-e0af3aa1ecd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:56.709506 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-148e7f49-041f-4e73-8827-e0af3aa1ecd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:56.718284 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-148e7f49-041f-4e73-8827-e0af3aa1ecd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:56.720690 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-148e7f49-041f-4e73-8827-e0af3aa1ecd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1751 microversion: 2.20 time: 0.407157 May 25 15:04:56.722082 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 389/765] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:56 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1751 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:57.740092 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1ea52cb7-1aaf-4220-81c5-e5370bf133d4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:57.740726 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1ea52cb7-1aaf-4220-81c5-e5370bf133d4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:57.756255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1ea52cb7-1aaf-4220-81c5-e5370bf133d4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:57.756727 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1ea52cb7-1aaf-4220-81c5-e5370bf133d4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:57.757539 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1ea52cb7-1aaf-4220-81c5-e5370bf133d4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:57.757985 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1ea52cb7-1aaf-4220-81c5-e5370bf133d4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:57.974367 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1ea52cb7-1aaf-4220-81c5-e5370bf133d4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:57.988217 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1ea52cb7-1aaf-4220-81c5-e5370bf133d4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:57.989747 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1ea52cb7-1aaf-4220-81c5-e5370bf133d4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:57.994227 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1ea52cb7-1aaf-4220-81c5-e5370bf133d4 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1753 microversion: 2.20 time: 0.258636 May 25 15:04:57.995579 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 377/766] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:57 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1753 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:59.014056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ecc5045d-28c2-47d6-a85e-1887b3cbaaa2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:59.014541 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ecc5045d-28c2-47d6-a85e-1887b3cbaaa2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:59.026066 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ecc5045d-28c2-47d6-a85e-1887b3cbaaa2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:59.026862 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ecc5045d-28c2-47d6-a85e-1887b3cbaaa2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:59.028943 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ecc5045d-28c2-47d6-a85e-1887b3cbaaa2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:59.035398 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ecc5045d-28c2-47d6-a85e-1887b3cbaaa2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:59.989862 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ecc5045d-28c2-47d6-a85e-1887b3cbaaa2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:00.014306 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ecc5045d-28c2-47d6-a85e-1887b3cbaaa2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:00.017504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ecc5045d-28c2-47d6-a85e-1887b3cbaaa2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:00.022930 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ecc5045d-28c2-47d6-a85e-1887b3cbaaa2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 1.013510 May 25 15:05:00.026688 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 390/767] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:04:59 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:01.045816 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7bd105e8-26a4-4006-85fe-26b40ad9eb5f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:01.047237 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7bd105e8-26a4-4006-85fe-26b40ad9eb5f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:01.056636 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7bd105e8-26a4-4006-85fe-26b40ad9eb5f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:01.057704 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7bd105e8-26a4-4006-85fe-26b40ad9eb5f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:01.058761 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7bd105e8-26a4-4006-85fe-26b40ad9eb5f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:01.059429 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7bd105e8-26a4-4006-85fe-26b40ad9eb5f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:01.546878 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7bd105e8-26a4-4006-85fe-26b40ad9eb5f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:01.574232 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7bd105e8-26a4-4006-85fe-26b40ad9eb5f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:01.579499 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7bd105e8-26a4-4006-85fe-26b40ad9eb5f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:01.581194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7bd105e8-26a4-4006-85fe-26b40ad9eb5f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.540337 May 25 15:05:01.596339 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 378/768] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:01 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:02.150049 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-09ddce89-4991-421d-ac7e-64bdc5e4c9c8 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1491941515", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1398894099", "security_groups": [{"name": "tempest-secgroup-smoke-1278455577"}], "block_device_mapping_v2": [{"uuid": "dc30e6c3-e742-4934-9a57-6ae84035470d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "620eaca4-828c-4c2d-a756-ed68aa31fbcf"}]}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:02.453686 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.network.neutron [None req-09ddce89-4991-421d-ac7e-64bdc5e4c9c8 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] validate_networks() for [('620eaca4-828c-4c2d-a756-ed68aa31fbcf', None, None, None, None, None)] {{(pid=124523) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:05:02.604786 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-73271a76-41ec-46ed-a2c9-715ba47e576f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:02.605542 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-73271a76-41ec-46ed-a2c9-715ba47e576f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:02.620244 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-73271a76-41ec-46ed-a2c9-715ba47e576f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:02.620689 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-73271a76-41ec-46ed-a2c9-715ba47e576f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:02.621497 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-73271a76-41ec-46ed-a2c9-715ba47e576f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:02.621901 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-73271a76-41ec-46ed-a2c9-715ba47e576f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:03.493595 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-73271a76-41ec-46ed-a2c9-715ba47e576f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:03.509423 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-73271a76-41ec-46ed-a2c9-715ba47e576f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:03.515224 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-73271a76-41ec-46ed-a2c9-715ba47e576f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:03.521689 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-73271a76-41ec-46ed-a2c9-715ba47e576f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.920598 May 25 15:05:03.524922 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 379/769] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:02 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:04.221059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-09ddce89-4991-421d-ac7e-64bdc5e4c9c8 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Flavor limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:05:04.221776 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-09ddce89-4991-421d-ac7e-64bdc5e4c9c8 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Image limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:05:04.222428 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-09ddce89-4991-421d-ac7e-64bdc5e4c9c8 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Flavor pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:05:04.223042 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-09ddce89-4991-421d-ac7e-64bdc5e4c9c8 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Image pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:05:04.223607 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-09ddce89-4991-421d-ac7e-64bdc5e4c9c8 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:05:04.238702 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-09ddce89-4991-421d-ac7e-64bdc5e4c9c8 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:04.245358 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-09ddce89-4991-421d-ac7e-64bdc5e4c9c8 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:04.249564 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-09ddce89-4991-421d-ac7e-64bdc5e4c9c8 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:04.250526 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-09ddce89-4991-421d-ac7e-64bdc5e4c9c8 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:04.330257 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-09ddce89-4991-421d-ac7e-64bdc5e4c9c8 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Getting quotas for project 99281bdc8f6340a1be03774c255ae4ba. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:05:04.355801 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-09ddce89-4991-421d-ac7e-64bdc5e4c9c8 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Getting quotas for user daec78050ee547699910603eff8cb7ca and project 99281bdc8f6340a1be03774c255ae4ba. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:05:04.528026 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-09ddce89-4991-421d-ac7e-64bdc5e4c9c8 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Going to run 1 instances... {{(pid=124523) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:05:04.531446 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-09ddce89-4991-421d-ac7e-64bdc5e4c9c8 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dc30e6c3-e742-4934-9a57-6ae84035470d',volume_size=None,volume_type=None)] {{(pid=124523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:05:04.543640 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7a6b1f44-18a5-4049-acfd-fb9506bec388 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:04.545132 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7a6b1f44-18a5-4049-acfd-fb9506bec388 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:04.560624 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7a6b1f44-18a5-4049-acfd-fb9506bec388 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:04.566848 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7a6b1f44-18a5-4049-acfd-fb9506bec388 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:04.567700 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7a6b1f44-18a5-4049-acfd-fb9506bec388 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:04.568141 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7a6b1f44-18a5-4049-acfd-fb9506bec388 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:04.677718 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:04.814935 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-09ddce89-4991-421d-ac7e-64bdc5e4c9c8 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.668817 May 25 15:05:04.815994 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 391/770] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 15:05:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 2671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:05:04.830923 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-1545071c-c844-46e8-8aa0-e1351d51304d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:04.832231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-1545071c-c844-46e8-8aa0-e1351d51304d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:04.929742 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-1545071c-c844-46e8-8aa0-e1351d51304d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:04.944833 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-1545071c-c844-46e8-8aa0-e1351d51304d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1095 microversion: 2.1 time: 0.122582 May 25 15:05:04.948393 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 392/771] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:04 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1095 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:05:05.309420 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7a6b1f44-18a5-4049-acfd-fb9506bec388 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:05.334423 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7a6b1f44-18a5-4049-acfd-fb9506bec388 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:05.340151 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7a6b1f44-18a5-4049-acfd-fb9506bec388 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:05.342353 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7a6b1f44-18a5-4049-acfd-fb9506bec388 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.802433 May 25 15:05:05.355716 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 380/772] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:04 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:05.963776 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-45277c39-4d5d-4fc8-89a3-dfff1f796c7b tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:05.964380 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-45277c39-4d5d-4fc8-89a3-dfff1f796c7b tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:05.982906 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-45277c39-4d5d-4fc8-89a3-dfff1f796c7b tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:05.983840 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-45277c39-4d5d-4fc8-89a3-dfff1f796c7b tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:05.984803 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-45277c39-4d5d-4fc8-89a3-dfff1f796c7b tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:05.985244 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-45277c39-4d5d-4fc8-89a3-dfff1f796c7b tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:06.361319 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-91b0aafe-91aa-4495-b0c9-a0191227a361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:06.362382 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-91b0aafe-91aa-4495-b0c9-a0191227a361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:06.383641 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-91b0aafe-91aa-4495-b0c9-a0191227a361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:06.384564 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-91b0aafe-91aa-4495-b0c9-a0191227a361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:06.386106 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-91b0aafe-91aa-4495-b0c9-a0191227a361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:06.386861 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-91b0aafe-91aa-4495-b0c9-a0191227a361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:06.761968 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-45277c39-4d5d-4fc8-89a3-dfff1f796c7b tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:06.773839 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-45277c39-4d5d-4fc8-89a3-dfff1f796c7b tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1145 microversion: 2.1 time: 0.814661 May 25 15:05:06.784574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 393/773] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:05 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1145 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:07.066277 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-91b0aafe-91aa-4495-b0c9-a0191227a361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:07.075484 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-91b0aafe-91aa-4495-b0c9-a0191227a361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:07.096284 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-91b0aafe-91aa-4495-b0c9-a0191227a361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:07.111584 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-91b0aafe-91aa-4495-b0c9-a0191227a361 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.754597 May 25 15:05:07.116054 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 381/774] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:06 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:05:07.801727 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-298ebe5b-a827-43fe-8a76-74d55fa39445 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:07.802367 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-298ebe5b-a827-43fe-8a76-74d55fa39445 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:07.815668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-298ebe5b-a827-43fe-8a76-74d55fa39445 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:07.816562 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-298ebe5b-a827-43fe-8a76-74d55fa39445 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:07.817684 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-298ebe5b-a827-43fe-8a76-74d55fa39445 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:07.818389 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-298ebe5b-a827-43fe-8a76-74d55fa39445 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:08.021990 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-298ebe5b-a827-43fe-8a76-74d55fa39445 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:08.030861 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-298ebe5b-a827-43fe-8a76-74d55fa39445 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1211 microversion: 2.1 time: 0.233193 May 25 15:05:08.034414 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 394/775] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:07 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1211 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:08.134291 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6533e182-f4a9-49da-a9dd-fcb26df56028 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:08.134906 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6533e182-f4a9-49da-a9dd-fcb26df56028 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:08.151530 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=32 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:08.153305 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6533e182-f4a9-49da-a9dd-fcb26df56028 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:08.153754 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6533e182-f4a9-49da-a9dd-fcb26df56028 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:08.155376 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6533e182-f4a9-49da-a9dd-fcb26df56028 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:08.155965 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6533e182-f4a9-49da-a9dd-fcb26df56028 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:08.589376 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6533e182-f4a9-49da-a9dd-fcb26df56028 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:08.613009 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6533e182-f4a9-49da-a9dd-fcb26df56028 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:08.620561 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6533e182-f4a9-49da-a9dd-fcb26df56028 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:08.625200 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6533e182-f4a9-49da-a9dd-fcb26df56028 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.495068 May 25 15:05:08.631603 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 382/776] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:08 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:05:08.649389 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-bf203d03-0028-4b42-b640-eda11ea36833 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Action: 'create', calling method: .version_select at 0x7fb1da752e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1083162931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIlznsqKXY5hRSEF3fYALJHcrfISecu9ZlVtIDTB81l6HPi9N1s1i5Owj2gI68kNdNMuiX+K6upSwMe3AS+HVfZ7bg157ECY86xOrcCFnanhoz0qIfR+L4xvC4OxxZXmg=="}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:08.684197 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-bf203d03-0028-4b42-b640-eda11ea36833 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Getting quotas for project ffb2008af6964bc5b2e94a630bfe78e5. Resources: {'key_pairs'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:05:08.697050 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-bf203d03-0028-4b42-b640-eda11ea36833 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Getting quotas for user 9c1bf697f0fd4e2cbc8d52cec772e446 and project ffb2008af6964bc5b2e94a630bfe78e5. Resources: {'key_pairs'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:05:08.750523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-bf203d03-0028-4b42-b640-eda11ea36833 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.458627 May 25 15:05:08.752470 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 395/777] 10.222.0.78 () {60 vars in 1158 bytes} [Wed May 25 15:05:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:05:09.055739 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-e4bdf7c9-5997-4736-98c7-f3e160d8922a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:09.056322 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-e4bdf7c9-5997-4736-98c7-f3e160d8922a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:09.070787 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e4bdf7c9-5997-4736-98c7-f3e160d8922a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:09.071262 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e4bdf7c9-5997-4736-98c7-f3e160d8922a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:09.072093 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e4bdf7c9-5997-4736-98c7-f3e160d8922a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:09.072516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e4bdf7c9-5997-4736-98c7-f3e160d8922a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:09.283755 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-e4bdf7c9-5997-4736-98c7-f3e160d8922a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:09.297190 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-e4bdf7c9-5997-4736-98c7-f3e160d8922a tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1199 microversion: 2.1 time: 0.242580 May 25 15:05:09.297945 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 383/778] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:09 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1199 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:09.653647 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-72bbaa32-923a-443f-9a4b-cdee8f2a11f2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:09.656121 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-72bbaa32-923a-443f-9a4b-cdee8f2a11f2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:09.678242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-72bbaa32-923a-443f-9a4b-cdee8f2a11f2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:09.680261 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-72bbaa32-923a-443f-9a4b-cdee8f2a11f2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:09.683984 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-72bbaa32-923a-443f-9a4b-cdee8f2a11f2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:09.684729 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-72bbaa32-923a-443f-9a4b-cdee8f2a11f2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:10.316081 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-450857d7-9878-4907-b6d5-ae355da8865d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:10.318515 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-450857d7-9878-4907-b6d5-ae355da8865d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:10.337333 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-450857d7-9878-4907-b6d5-ae355da8865d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:10.338230 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-450857d7-9878-4907-b6d5-ae355da8865d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:10.341140 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-450857d7-9878-4907-b6d5-ae355da8865d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:10.342477 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-450857d7-9878-4907-b6d5-ae355da8865d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:10.494557 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-72bbaa32-923a-443f-9a4b-cdee8f2a11f2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:10.512611 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-72bbaa32-923a-443f-9a4b-cdee8f2a11f2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:10.520139 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-72bbaa32-923a-443f-9a4b-cdee8f2a11f2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:10.525638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-72bbaa32-923a-443f-9a4b-cdee8f2a11f2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.874314 May 25 15:05:10.538273 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 396/779] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:09 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:11.203121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-450857d7-9878-4907-b6d5-ae355da8865d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:11.224981 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-450857d7-9878-4907-b6d5-ae355da8865d tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1267 microversion: 2.1 time: 0.913551 May 25 15:05:11.228126 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 384/780] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:10 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1267 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:05:11.553170 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-108604ca-8df4-4aff-b40a-9bfe31e7d988 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:11.553947 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-108604ca-8df4-4aff-b40a-9bfe31e7d988 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:11.570799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-108604ca-8df4-4aff-b40a-9bfe31e7d988 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:11.573523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-108604ca-8df4-4aff-b40a-9bfe31e7d988 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:11.575344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-108604ca-8df4-4aff-b40a-9bfe31e7d988 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:11.581650 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-108604ca-8df4-4aff-b40a-9bfe31e7d988 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:12.138753 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-108604ca-8df4-4aff-b40a-9bfe31e7d988 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:12.165536 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-108604ca-8df4-4aff-b40a-9bfe31e7d988 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:12.172920 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-108604ca-8df4-4aff-b40a-9bfe31e7d988 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:12.176141 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-108604ca-8df4-4aff-b40a-9bfe31e7d988 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.629338 May 25 15:05:12.189689 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 397/781] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:11 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:12.248384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-59eecd95-ca36-4e64-b5f0-b653f7d7bd40 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:12.249683 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-59eecd95-ca36-4e64-b5f0-b653f7d7bd40 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:12.296038 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-59eecd95-ca36-4e64-b5f0-b653f7d7bd40 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:12.296876 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-59eecd95-ca36-4e64-b5f0-b653f7d7bd40 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:12.297968 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-59eecd95-ca36-4e64-b5f0-b653f7d7bd40 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:12.298669 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-59eecd95-ca36-4e64-b5f0-b653f7d7bd40 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:12.768013 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-12582dbc-c70f-4075-b6c8-1e1e44c16dc6 req-2cd143c3-7d1d-4f6e-9dc8-9f69001da6dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ab710e-55b1-4cab-861c-4df85276e296", "tag": "af13f183-e203-48b0-88ea-6554e58e9b95"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:12.802540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-12582dbc-c70f-4075-b6c8-1e1e44c16dc6 req-2cd143c3-7d1d-4f6e-9dc8-9f69001da6dd service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:12.804938 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-12582dbc-c70f-4075-b6c8-1e1e44c16dc6 req-2cd143c3-7d1d-4f6e-9dc8-9f69001da6dd service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:12.881029 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-12582dbc-c70f-4075-b6c8-1e1e44c16dc6 req-2cd143c3-7d1d-4f6e-9dc8-9f69001da6dd service nova] Creating event network-changed:af13f183-e203-48b0-88ea-6554e58e9b95 for instance c0ab710e-55b1-4cab-861c-4df85276e296 on hv-cinder-80382 May 25 15:05:12.893074 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-12582dbc-c70f-4075-b6c8-1e1e44c16dc6 req-2cd143c3-7d1d-4f6e-9dc8-9f69001da6dd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128984 May 25 15:05:12.910799 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 398/782] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:05:12.952608 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-59eecd95-ca36-4e64-b5f0-b653f7d7bd40 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:12.966722 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-59eecd95-ca36-4e64-b5f0-b653f7d7bd40 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1267 microversion: 2.1 time: 0.721912 May 25 15:05:12.968555 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 385/783] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:12 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1267 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:13.201643 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a0a97bf1-6705-4584-a95d-b68291e944c1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:13.203221 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a0a97bf1-6705-4584-a95d-b68291e944c1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:13.228776 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a0a97bf1-6705-4584-a95d-b68291e944c1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:13.229501 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a0a97bf1-6705-4584-a95d-b68291e944c1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:13.231499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a0a97bf1-6705-4584-a95d-b68291e944c1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:13.234700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a0a97bf1-6705-4584-a95d-b68291e944c1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:13.847461 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a0a97bf1-6705-4584-a95d-b68291e944c1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:13.868961 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a0a97bf1-6705-4584-a95d-b68291e944c1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:13.877465 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a0a97bf1-6705-4584-a95d-b68291e944c1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:13.883348 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a0a97bf1-6705-4584-a95d-b68291e944c1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.687842 May 25 15:05:13.884911 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 399/784] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:13 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:13.989465 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-f88f1785-0b89-44f2-af43-774fe8b5b8c6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:13.990796 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-f88f1785-0b89-44f2-af43-774fe8b5b8c6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:14.005018 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f88f1785-0b89-44f2-af43-774fe8b5b8c6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:14.005900 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f88f1785-0b89-44f2-af43-774fe8b5b8c6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:14.007048 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f88f1785-0b89-44f2-af43-774fe8b5b8c6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:14.007704 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f88f1785-0b89-44f2-af43-774fe8b5b8c6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:14.329079 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-f88f1785-0b89-44f2-af43-774fe8b5b8c6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:14.338333 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-f88f1785-0b89-44f2-af43-774fe8b5b8c6 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1267 microversion: 2.1 time: 0.357910 May 25 15:05:14.339679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 386/785] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:13 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1267 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:14.909062 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b2313fe4-47a4-49a3-88ab-827f94c0fd52 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:14.911983 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-b2313fe4-47a4-49a3-88ab-827f94c0fd52 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:14.937100 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=2 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:14.982226 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b2313fe4-47a4-49a3-88ab-827f94c0fd52 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:14.985541 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b2313fe4-47a4-49a3-88ab-827f94c0fd52 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:14.994306 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b2313fe4-47a4-49a3-88ab-827f94c0fd52 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:14.997431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b2313fe4-47a4-49a3-88ab-827f94c0fd52 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:15.356452 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-33980b57-43c6-4209-a1ff-c3c83ac5ad68 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:15.357384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-33980b57-43c6-4209-a1ff-c3c83ac5ad68 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:15.396976 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-33980b57-43c6-4209-a1ff-c3c83ac5ad68 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:15.398107 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-33980b57-43c6-4209-a1ff-c3c83ac5ad68 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:15.402997 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-33980b57-43c6-4209-a1ff-c3c83ac5ad68 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:15.403380 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-33980b57-43c6-4209-a1ff-c3c83ac5ad68 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:15.826516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-33980b57-43c6-4209-a1ff-c3c83ac5ad68 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:15.837219 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-33980b57-43c6-4209-a1ff-c3c83ac5ad68 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1267 microversion: 2.1 time: 0.484955 May 25 15:05:15.843189 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 387/786] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:15 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1267 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:05:15.889963 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-b2313fe4-47a4-49a3-88ab-827f94c0fd52 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:15.900622 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-b2313fe4-47a4-49a3-88ab-827f94c0fd52 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:15.902194 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-b2313fe4-47a4-49a3-88ab-827f94c0fd52 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:15.917828 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-b2313fe4-47a4-49a3-88ab-827f94c0fd52 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 1.014265 May 25 15:05:15.918483 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 400/787] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:14 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:16.859773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2fe7e398-1f16-420d-9ac3-c6deb0eb34cd tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:16.860391 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2fe7e398-1f16-420d-9ac3-c6deb0eb34cd tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:16.876595 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2fe7e398-1f16-420d-9ac3-c6deb0eb34cd tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:16.877299 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2fe7e398-1f16-420d-9ac3-c6deb0eb34cd tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:16.878335 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2fe7e398-1f16-420d-9ac3-c6deb0eb34cd tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:16.879108 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2fe7e398-1f16-420d-9ac3-c6deb0eb34cd tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:16.935704 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2502b0c7-7bcf-4173-a60e-b5b46a389ce8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:16.936945 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2502b0c7-7bcf-4173-a60e-b5b46a389ce8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:16.948621 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2502b0c7-7bcf-4173-a60e-b5b46a389ce8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:16.949359 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2502b0c7-7bcf-4173-a60e-b5b46a389ce8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:16.950354 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2502b0c7-7bcf-4173-a60e-b5b46a389ce8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:16.950961 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2502b0c7-7bcf-4173-a60e-b5b46a389ce8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:17.308956 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-2fe7e398-1f16-420d-9ac3-c6deb0eb34cd tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:17.325479 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2fe7e398-1f16-420d-9ac3-c6deb0eb34cd tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1267 microversion: 2.1 time: 0.469656 May 25 15:05:17.330129 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 388/788] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:16 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1267 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:05:17.355724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2502b0c7-7bcf-4173-a60e-b5b46a389ce8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:17.375566 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2502b0c7-7bcf-4173-a60e-b5b46a389ce8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:17.380724 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2502b0c7-7bcf-4173-a60e-b5b46a389ce8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:17.381964 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2502b0c7-7bcf-4173-a60e-b5b46a389ce8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.450395 May 25 15:05:17.394823 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 401/789] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:16 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:05:18.347459 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-ac825aae-5760-40a8-81b7-bcc977295252 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:18.349166 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-ac825aae-5760-40a8-81b7-bcc977295252 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:18.372746 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ac825aae-5760-40a8-81b7-bcc977295252 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:18.384818 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ac825aae-5760-40a8-81b7-bcc977295252 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:18.388371 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ac825aae-5760-40a8-81b7-bcc977295252 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:18.389121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ac825aae-5760-40a8-81b7-bcc977295252 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:18.409390 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-7d6338d3-27fc-4586-9b6b-474a38d7590d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:18.410121 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-7d6338d3-27fc-4586-9b6b-474a38d7590d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:18.422115 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7d6338d3-27fc-4586-9b6b-474a38d7590d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:18.422575 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7d6338d3-27fc-4586-9b6b-474a38d7590d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:18.423370 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7d6338d3-27fc-4586-9b6b-474a38d7590d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:18.426681 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7d6338d3-27fc-4586-9b6b-474a38d7590d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:18.713214 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-ac825aae-5760-40a8-81b7-bcc977295252 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:18.722200 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=12 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:18.729128 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-ac825aae-5760-40a8-81b7-bcc977295252 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1267 microversion: 2.1 time: 0.387368 May 25 15:05:18.741189 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 389/790] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:18 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1267 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:18.769979 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-7d6338d3-27fc-4586-9b6b-474a38d7590d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:18.783321 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-7d6338d3-27fc-4586-9b6b-474a38d7590d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:18.785131 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-7d6338d3-27fc-4586-9b6b-474a38d7590d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:18.787403 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-7d6338d3-27fc-4586-9b6b-474a38d7590d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.384357 May 25 15:05:18.788584 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 402/791] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:18 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:19.748092 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7017687b-98bd-4895-8755-29431d74bb02 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:19.748912 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7017687b-98bd-4895-8755-29431d74bb02 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:19.756600 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7017687b-98bd-4895-8755-29431d74bb02 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:19.757361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7017687b-98bd-4895-8755-29431d74bb02 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:19.758395 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7017687b-98bd-4895-8755-29431d74bb02 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:19.758992 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7017687b-98bd-4895-8755-29431d74bb02 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:19.818085 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2065485a-a046-4cd9-ae2b-a93918eaac72 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:19.820091 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2065485a-a046-4cd9-ae2b-a93918eaac72 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:19.831420 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2065485a-a046-4cd9-ae2b-a93918eaac72 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:19.834484 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2065485a-a046-4cd9-ae2b-a93918eaac72 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:19.835625 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2065485a-a046-4cd9-ae2b-a93918eaac72 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:19.837206 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2065485a-a046-4cd9-ae2b-a93918eaac72 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:19.982195 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7017687b-98bd-4895-8755-29431d74bb02 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:19.992921 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7017687b-98bd-4895-8755-29431d74bb02 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1267 microversion: 2.1 time: 0.248721 May 25 15:05:20.003184 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 390/792] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:19 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:20.240632 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2065485a-a046-4cd9-ae2b-a93918eaac72 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:20.259848 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2065485a-a046-4cd9-ae2b-a93918eaac72 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:20.261747 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2065485a-a046-4cd9-ae2b-a93918eaac72 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:20.263068 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2065485a-a046-4cd9-ae2b-a93918eaac72 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.456997 May 25 15:05:20.263710 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 403/793] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:19 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:05:21.016411 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-ce44ab88-d2a7-4e8c-92bf-f5dc564987fb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:21.018344 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-ce44ab88-d2a7-4e8c-92bf-f5dc564987fb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:21.029309 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ce44ab88-d2a7-4e8c-92bf-f5dc564987fb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:21.029800 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ce44ab88-d2a7-4e8c-92bf-f5dc564987fb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:21.031150 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ce44ab88-d2a7-4e8c-92bf-f5dc564987fb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:21.031597 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ce44ab88-d2a7-4e8c-92bf-f5dc564987fb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:21.229563 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-ce44ab88-d2a7-4e8c-92bf-f5dc564987fb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:21.243180 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-ce44ab88-d2a7-4e8c-92bf-f5dc564987fb tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1267 microversion: 2.1 time: 0.233804 May 25 15:05:21.244190 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 391/794] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:21 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:21.283410 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-71fdffe5-1659-483c-a7d8-5a2107f7168f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:21.284006 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-71fdffe5-1659-483c-a7d8-5a2107f7168f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:21.296057 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-71fdffe5-1659-483c-a7d8-5a2107f7168f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:21.296512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-71fdffe5-1659-483c-a7d8-5a2107f7168f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:21.297332 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-71fdffe5-1659-483c-a7d8-5a2107f7168f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:21.297750 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-71fdffe5-1659-483c-a7d8-5a2107f7168f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:21.560079 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-71fdffe5-1659-483c-a7d8-5a2107f7168f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:21.601735 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-71fdffe5-1659-483c-a7d8-5a2107f7168f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:21.618531 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-71fdffe5-1659-483c-a7d8-5a2107f7168f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:21.622230 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-71fdffe5-1659-483c-a7d8-5a2107f7168f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.342388 May 25 15:05:21.632906 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 404/795] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:21 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:22.261168 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-339dcb6c-0793-4b5f-b729-46f6100c10df tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:22.262478 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-339dcb6c-0793-4b5f-b729-46f6100c10df tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:22.269993 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-339dcb6c-0793-4b5f-b729-46f6100c10df tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:22.270977 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-339dcb6c-0793-4b5f-b729-46f6100c10df tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:22.271944 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-339dcb6c-0793-4b5f-b729-46f6100c10df tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:22.272581 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-339dcb6c-0793-4b5f-b729-46f6100c10df tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:22.447064 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-339dcb6c-0793-4b5f-b729-46f6100c10df tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:22.456714 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-339dcb6c-0793-4b5f-b729-46f6100c10df tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1267 microversion: 2.1 time: 0.200284 May 25 15:05:22.467122 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 392/796] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:22 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:22.641152 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-9a43b08f-59ff-461d-8903-72404001614a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:22.641759 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-9a43b08f-59ff-461d-8903-72404001614a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:22.648742 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9a43b08f-59ff-461d-8903-72404001614a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:22.650572 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9a43b08f-59ff-461d-8903-72404001614a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:22.650572 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9a43b08f-59ff-461d-8903-72404001614a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:22.650572 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9a43b08f-59ff-461d-8903-72404001614a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:22.808903 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-9a43b08f-59ff-461d-8903-72404001614a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:22.818411 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-9a43b08f-59ff-461d-8903-72404001614a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:22.819909 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-9a43b08f-59ff-461d-8903-72404001614a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:22.821289 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-9a43b08f-59ff-461d-8903-72404001614a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.184317 May 25 15:05:22.832579 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 405/797] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:22 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:23.475776 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d220278d-bdd4-40e8-910a-b424f2fb2583 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:23.477112 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d220278d-bdd4-40e8-910a-b424f2fb2583 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:23.485147 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d220278d-bdd4-40e8-910a-b424f2fb2583 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:23.485882 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d220278d-bdd4-40e8-910a-b424f2fb2583 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:23.491764 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d220278d-bdd4-40e8-910a-b424f2fb2583 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:23.492767 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d220278d-bdd4-40e8-910a-b424f2fb2583 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:23.683329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d220278d-bdd4-40e8-910a-b424f2fb2583 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:23.693389 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d220278d-bdd4-40e8-910a-b424f2fb2583 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1267 microversion: 2.1 time: 0.221751 May 25 15:05:23.694291 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 393/798] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:23 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:23.839368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f43e9089-958e-4e1e-b558-49d7dbf66e95 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:23.840044 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f43e9089-958e-4e1e-b558-49d7dbf66e95 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:23.850463 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f43e9089-958e-4e1e-b558-49d7dbf66e95 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:23.851191 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f43e9089-958e-4e1e-b558-49d7dbf66e95 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:23.852155 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f43e9089-958e-4e1e-b558-49d7dbf66e95 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:23.852760 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f43e9089-958e-4e1e-b558-49d7dbf66e95 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:24.017315 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f43e9089-958e-4e1e-b558-49d7dbf66e95 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:24.027270 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f43e9089-958e-4e1e-b558-49d7dbf66e95 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:24.029207 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f43e9089-958e-4e1e-b558-49d7dbf66e95 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:24.031636 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f43e9089-958e-4e1e-b558-49d7dbf66e95 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.196245 May 25 15:05:24.048068 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 406/799] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:23 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:24.710966 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-3c16e995-c535-4b59-9a23-026d4946b3e5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:24.711581 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-3c16e995-c535-4b59-9a23-026d4946b3e5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:24.718585 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3c16e995-c535-4b59-9a23-026d4946b3e5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:24.719068 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3c16e995-c535-4b59-9a23-026d4946b3e5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:24.719861 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3c16e995-c535-4b59-9a23-026d4946b3e5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:24.720296 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3c16e995-c535-4b59-9a23-026d4946b3e5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:24.882766 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3c16e995-c535-4b59-9a23-026d4946b3e5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:24.892544 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-3c16e995-c535-4b59-9a23-026d4946b3e5 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1267 microversion: 2.1 time: 0.185394 May 25 15:05:24.903045 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 394/800] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:24 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:25.050404 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f8b77566-c9eb-44ca-93cd-5c63503cc10a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:25.051018 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f8b77566-c9eb-44ca-93cd-5c63503cc10a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:25.058574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f8b77566-c9eb-44ca-93cd-5c63503cc10a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:25.059287 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f8b77566-c9eb-44ca-93cd-5c63503cc10a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:25.060275 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f8b77566-c9eb-44ca-93cd-5c63503cc10a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:25.062102 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f8b77566-c9eb-44ca-93cd-5c63503cc10a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:25.209134 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f8b77566-c9eb-44ca-93cd-5c63503cc10a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:25.218175 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f8b77566-c9eb-44ca-93cd-5c63503cc10a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:25.220017 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f8b77566-c9eb-44ca-93cd-5c63503cc10a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:25.221555 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f8b77566-c9eb-44ca-93cd-5c63503cc10a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.174990 May 25 15:05:25.222387 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 407/801] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:25 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:25.412812 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-25ad85e2-3924-4bf4-a638-c64c36317aa4 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Action: 'create', calling method: .version_select at 0x7fb1dad695e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1061173293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjNbbcq2WDGdmP8g14jDirbXdZG8/P2EshYZy+VrBPWhfPaQsIt7vni6HR1ndggoV6hPdWw83KSqUkqgHlpJSTlmpEq117B2TLUsSOHjDfgMzewradCIp8M7Tsd25mf5Q=="}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:25.418489 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-4fd825d0-fbdb-4d4d-8028-eaac1fb797f1 req-f8b4a9f0-2f94-4784-bd80-21fc256c583e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ab710e-55b1-4cab-861c-4df85276e296", "name": "network-vif-plugged", "status": "completed", "tag": "af13f183-e203-48b0-88ea-6554e58e9b95"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:25.428851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-4fd825d0-fbdb-4d4d-8028-eaac1fb797f1 req-f8b4a9f0-2f94-4784-bd80-21fc256c583e service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:25.429414 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-4fd825d0-fbdb-4d4d-8028-eaac1fb797f1 req-f8b4a9f0-2f94-4784-bd80-21fc256c583e service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:25.433480 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-25ad85e2-3924-4bf4-a638-c64c36317aa4 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Getting quotas for project 5e9e55701e7c4fe180a21d1934298240. Resources: {'key_pairs'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:05:25.437604 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-25ad85e2-3924-4bf4-a638-c64c36317aa4 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Getting quotas for user f892dfa98adb40198ce1296134d1263c and project 5e9e55701e7c4fe180a21d1934298240. Resources: {'key_pairs'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:05:25.443541 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-4fd825d0-fbdb-4d4d-8028-eaac1fb797f1 req-f8b4a9f0-2f94-4784-bd80-21fc256c583e service nova] Creating event network-vif-plugged:af13f183-e203-48b0-88ea-6554e58e9b95 for instance c0ab710e-55b1-4cab-861c-4df85276e296 on hv-cinder-80382 May 25 15:05:25.449241 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-4fd825d0-fbdb-4d4d-8028-eaac1fb797f1 req-f8b4a9f0-2f94-4784-bd80-21fc256c583e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035135 May 25 15:05:25.450281 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 408/802] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:05:25.463160 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-25ad85e2-3924-4bf4-a638-c64c36317aa4 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054349 May 25 15:05:25.463705 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 395/803] 10.222.0.78 () {60 vars in 1158 bytes} [Wed May 25 15:05:25 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:05:25.516626 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a587d9a7-98b4-4f7c-a8cc-4988f8a6386e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1501490668", "imageRef": "56f4097c-8d8f-42e6-932a-c648380df21d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1061173293", "networks": [{"uuid": "f7618e0a-05c6-4611-8c95-878452bf932d"}]}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:25.574675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.network.neutron [None req-a587d9a7-98b4-4f7c-a8cc-4988f8a6386e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] validate_networks() for [('f7618e0a-05c6-4611-8c95-878452bf932d', None, None, None, None, None)] {{(pid=124523) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:05:25.911079 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0df02923-a6e3-43d8-a21b-4b662da0ef51 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:25.911702 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0df02923-a6e3-43d8-a21b-4b662da0ef51 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:25.918066 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0df02923-a6e3-43d8-a21b-4b662da0ef51 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:25.918463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0df02923-a6e3-43d8-a21b-4b662da0ef51 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:25.919235 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0df02923-a6e3-43d8-a21b-4b662da0ef51 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:25.919671 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0df02923-a6e3-43d8-a21b-4b662da0ef51 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:26.042812 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-a587d9a7-98b4-4f7c-a8cc-4988f8a6386e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Flavor limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:05:26.043454 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-a587d9a7-98b4-4f7c-a8cc-4988f8a6386e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Image limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:05:26.043993 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-a587d9a7-98b4-4f7c-a8cc-4988f8a6386e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Flavor pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:05:26.044469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-a587d9a7-98b4-4f7c-a8cc-4988f8a6386e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Image pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:05:26.044979 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-a587d9a7-98b4-4f7c-a8cc-4988f8a6386e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:05:26.053982 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a587d9a7-98b4-4f7c-a8cc-4988f8a6386e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:26.054741 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a587d9a7-98b4-4f7c-a8cc-4988f8a6386e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:26.055410 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a587d9a7-98b4-4f7c-a8cc-4988f8a6386e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:26.055910 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a587d9a7-98b4-4f7c-a8cc-4988f8a6386e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:26.059763 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-0df02923-a6e3-43d8-a21b-4b662da0ef51 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:26.068022 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0df02923-a6e3-43d8-a21b-4b662da0ef51 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1267 microversion: 2.1 time: 0.161350 May 25 15:05:26.068672 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 396/804] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:25 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:05:26.075127 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-a587d9a7-98b4-4f7c-a8cc-4988f8a6386e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Getting quotas for project 5e9e55701e7c4fe180a21d1934298240. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:05:26.080201 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-a587d9a7-98b4-4f7c-a8cc-4988f8a6386e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Getting quotas for user f892dfa98adb40198ce1296134d1263c and project 5e9e55701e7c4fe180a21d1934298240. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:05:26.091698 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a587d9a7-98b4-4f7c-a8cc-4988f8a6386e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Going to run 1 instances... {{(pid=124523) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:05:26.094091 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a587d9a7-98b4-4f7c-a8cc-4988f8a6386e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56f4097c-8d8f-42e6-932a-c648380df21d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:05:26.139604 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a587d9a7-98b4-4f7c-a8cc-4988f8a6386e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626618 May 25 15:05:26.140245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 409/805] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 15:05:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:05:26.150184 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1a74f467-9333-4dbf-9c81-8fa3135b6383 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:26.150897 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1a74f467-9333-4dbf-9c81-8fa3135b6383 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:26.206028 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1a74f467-9333-4dbf-9c81-8fa3135b6383 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:26.212712 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1a74f467-9333-4dbf-9c81-8fa3135b6383 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1259 microversion: 2.1 time: 0.066496 May 25 15:05:26.213285 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 397/806] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:26 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:26.239804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-eea3a4f7-6c35-4677-a2d2-afb68d1895f5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:26.240421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-eea3a4f7-6c35-4677-a2d2-afb68d1895f5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:26.247447 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-eea3a4f7-6c35-4677-a2d2-afb68d1895f5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:26.247886 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-eea3a4f7-6c35-4677-a2d2-afb68d1895f5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:26.249190 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-eea3a4f7-6c35-4677-a2d2-afb68d1895f5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:26.249620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-eea3a4f7-6c35-4677-a2d2-afb68d1895f5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:26.265661 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=100 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:26.386405 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-eea3a4f7-6c35-4677-a2d2-afb68d1895f5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:26.396420 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-eea3a4f7-6c35-4677-a2d2-afb68d1895f5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:26.398424 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-eea3a4f7-6c35-4677-a2d2-afb68d1895f5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:26.399741 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-eea3a4f7-6c35-4677-a2d2-afb68d1895f5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.163741 May 25 15:05:26.410234 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 410/807] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:26 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:27.084691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-45fe8bb2-55b1-46c5-ae67-23ee7f963e96 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:27.085392 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-45fe8bb2-55b1-46c5-ae67-23ee7f963e96 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:27.094500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-45fe8bb2-55b1-46c5-ae67-23ee7f963e96 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:27.094953 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-45fe8bb2-55b1-46c5-ae67-23ee7f963e96 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:27.096452 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-45fe8bb2-55b1-46c5-ae67-23ee7f963e96 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:27.096908 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-45fe8bb2-55b1-46c5-ae67-23ee7f963e96 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:27.229023 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-adbbafab-eb07-45f7-9dbf-ffd37469c93f tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:27.229644 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-adbbafab-eb07-45f7-9dbf-ffd37469c93f tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:27.232008 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:27.237875 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-adbbafab-eb07-45f7-9dbf-ffd37469c93f tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:27.238723 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-adbbafab-eb07-45f7-9dbf-ffd37469c93f tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:27.239598 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-adbbafab-eb07-45f7-9dbf-ffd37469c93f tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:27.240045 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-adbbafab-eb07-45f7-9dbf-ffd37469c93f tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:27.244260 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-45fe8bb2-55b1-46c5-ae67-23ee7f963e96 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:27.246509 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=100 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:27.265966 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-45fe8bb2-55b1-46c5-ae67-23ee7f963e96 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1267 microversion: 2.1 time: 0.184966 May 25 15:05:27.266698 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 398/808] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:27 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:27.327384 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-adbbafab-eb07-45f7-9dbf-ffd37469c93f tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:27.336445 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-adbbafab-eb07-45f7-9dbf-ffd37469c93f tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1311 microversion: 2.1 time: 0.111225 May 25 15:05:27.336945 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 411/809] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:27 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:27.418799 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-57297ec3-d64c-4464-8c9f-6ca04d011bb5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:27.419416 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-57297ec3-d64c-4464-8c9f-6ca04d011bb5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:27.426290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-57297ec3-d64c-4464-8c9f-6ca04d011bb5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:27.426739 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-57297ec3-d64c-4464-8c9f-6ca04d011bb5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:27.427511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-57297ec3-d64c-4464-8c9f-6ca04d011bb5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:27.427949 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-57297ec3-d64c-4464-8c9f-6ca04d011bb5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:27.583929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-57297ec3-d64c-4464-8c9f-6ca04d011bb5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:27.592734 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-57297ec3-d64c-4464-8c9f-6ca04d011bb5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:27.594439 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-57297ec3-d64c-4464-8c9f-6ca04d011bb5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:27.595804 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-57297ec3-d64c-4464-8c9f-6ca04d011bb5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.180991 May 25 15:05:27.596874 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 399/810] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:27 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:28.283654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a13b16ab-2fad-4803-b3f9-c0af66c82a8f tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:28.284382 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a13b16ab-2fad-4803-b3f9-c0af66c82a8f tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:28.290791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a13b16ab-2fad-4803-b3f9-c0af66c82a8f tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:28.291243 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a13b16ab-2fad-4803-b3f9-c0af66c82a8f tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:28.292016 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a13b16ab-2fad-4803-b3f9-c0af66c82a8f tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:28.292544 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a13b16ab-2fad-4803-b3f9-c0af66c82a8f tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:28.354573 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-63fc08f0-3f49-4d7d-bd89-da4b38cb0882 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:28.355166 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-63fc08f0-3f49-4d7d-bd89-da4b38cb0882 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:28.363831 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-63fc08f0-3f49-4d7d-bd89-da4b38cb0882 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:28.364250 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-63fc08f0-3f49-4d7d-bd89-da4b38cb0882 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:28.365118 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-63fc08f0-3f49-4d7d-bd89-da4b38cb0882 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:28.365799 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-63fc08f0-3f49-4d7d-bd89-da4b38cb0882 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:28.445518 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-63fc08f0-3f49-4d7d-bd89-da4b38cb0882 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:28.457319 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-63fc08f0-3f49-4d7d-bd89-da4b38cb0882 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1329 microversion: 2.1 time: 0.106495 May 25 15:05:28.458524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 400/811] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:28 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1329 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:05:28.513864 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a13b16ab-2fad-4803-b3f9-c0af66c82a8f tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:28.522423 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a13b16ab-2fad-4803-b3f9-c0af66c82a8f tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1454 microversion: 2.1 time: 0.243124 May 25 15:05:28.523018 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 412/812] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:28 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1454 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:28.538976 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-ebec7044-d4c6-4549-84e0-cbb68ef23307 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:28.539627 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-ebec7044-d4c6-4549-84e0-cbb68ef23307 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:28.546572 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ebec7044-d4c6-4549-84e0-cbb68ef23307 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:28.547145 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ebec7044-d4c6-4549-84e0-cbb68ef23307 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:28.548062 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ebec7044-d4c6-4549-84e0-cbb68ef23307 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:28.548500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ebec7044-d4c6-4549-84e0-cbb68ef23307 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:28.616530 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-5240de72-2a96-4329-992a-4b38383850a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:28.617146 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-5240de72-2a96-4329-992a-4b38383850a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:28.623342 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5240de72-2a96-4329-992a-4b38383850a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:28.623814 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5240de72-2a96-4329-992a-4b38383850a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:28.624602 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5240de72-2a96-4329-992a-4b38383850a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:28.625037 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5240de72-2a96-4329-992a-4b38383850a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:28.703820 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-ebec7044-d4c6-4549-84e0-cbb68ef23307 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:28.711798 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-ebec7044-d4c6-4549-84e0-cbb68ef23307 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1454 microversion: 2.1 time: 0.176748 May 25 15:05:28.712382 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 401/813] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:28 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1454 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:28.892508 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5240de72-2a96-4329-992a-4b38383850a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:28.920467 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5240de72-2a96-4329-992a-4b38383850a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:28.922345 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5240de72-2a96-4329-992a-4b38383850a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:28.923738 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-5240de72-2a96-4329-992a-4b38383850a5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.311118 May 25 15:05:28.935094 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 413/814] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:28 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:05:29.475194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-bb797c82-6733-4a1e-b652-7dd7e43f0cab tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:29.475890 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-bb797c82-6733-4a1e-b652-7dd7e43f0cab tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:29.488914 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bb797c82-6733-4a1e-b652-7dd7e43f0cab tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:29.488914 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bb797c82-6733-4a1e-b652-7dd7e43f0cab tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:29.494610 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bb797c82-6733-4a1e-b652-7dd7e43f0cab tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:29.496728 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bb797c82-6733-4a1e-b652-7dd7e43f0cab tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:29.648272 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-f18f8510-facb-4694-9671-25373c6ac960 req-7db3c01e-c037-418a-9a68-9fff1bd0b5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879adce9-e352-4e39-b80b-dcaee814c084", "name": "network-vif-plugged", "status": "completed", "tag": "1f402e27-3709-41db-8b59-49501ea83eb5"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:29.664259 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-f18f8510-facb-4694-9671-25373c6ac960 req-7db3c01e-c037-418a-9a68-9fff1bd0b5b4 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:29.665090 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-f18f8510-facb-4694-9671-25373c6ac960 req-7db3c01e-c037-418a-9a68-9fff1bd0b5b4 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:29.682251 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-f18f8510-facb-4694-9671-25373c6ac960 req-7db3c01e-c037-418a-9a68-9fff1bd0b5b4 service nova] Creating event network-vif-plugged:1f402e27-3709-41db-8b59-49501ea83eb5 for instance 879adce9-e352-4e39-b80b-dcaee814c084 on hv-cinder-80382 May 25 15:05:29.683375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-bb797c82-6733-4a1e-b652-7dd7e43f0cab tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:29.692222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-bb797c82-6733-4a1e-b652-7dd7e43f0cab tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1317 microversion: 2.1 time: 0.221172 May 25 15:05:29.698693 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 402/815] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:29 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:29.702614 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-f18f8510-facb-4694-9671-25373c6ac960 req-7db3c01e-c037-418a-9a68-9fff1bd0b5b4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057474 May 25 15:05:29.705562 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 414/816] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:05:29.943923 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-cf18385b-a3da-4be6-af41-80109cb0f30a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:29.944668 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-cf18385b-a3da-4be6-af41-80109cb0f30a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:29.959135 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cf18385b-a3da-4be6-af41-80109cb0f30a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:29.959135 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cf18385b-a3da-4be6-af41-80109cb0f30a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:29.960982 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cf18385b-a3da-4be6-af41-80109cb0f30a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:29.961691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-cf18385b-a3da-4be6-af41-80109cb0f30a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:30.290115 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-cf18385b-a3da-4be6-af41-80109cb0f30a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:30.301981 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-cf18385b-a3da-4be6-af41-80109cb0f30a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:30.303769 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-cf18385b-a3da-4be6-af41-80109cb0f30a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:30.305179 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-cf18385b-a3da-4be6-af41-80109cb0f30a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.366019 May 25 15:05:30.306248 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 403/817] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:29 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:30.717352 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-bf370893-12e1-4479-9409-9eb113e130be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:30.718076 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-bf370893-12e1-4479-9409-9eb113e130be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:30.725116 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bf370893-12e1-4479-9409-9eb113e130be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:30.725563 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bf370893-12e1-4479-9409-9eb113e130be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:30.726369 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bf370893-12e1-4479-9409-9eb113e130be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:30.726803 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bf370893-12e1-4479-9409-9eb113e130be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:30.955080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-bf370893-12e1-4479-9409-9eb113e130be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:30.969233 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-bf370893-12e1-4479-9409-9eb113e130be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1359 microversion: 2.1 time: 0.254596 May 25 15:05:30.986042 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 415/818] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:30 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1359 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:31.323755 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1375359c-19d4-48e8-8ec3-a644679475ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:31.324368 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1375359c-19d4-48e8-8ec3-a644679475ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:31.332085 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1375359c-19d4-48e8-8ec3-a644679475ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:31.332478 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1375359c-19d4-48e8-8ec3-a644679475ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:31.333310 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1375359c-19d4-48e8-8ec3-a644679475ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:31.334568 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1375359c-19d4-48e8-8ec3-a644679475ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:31.613665 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1375359c-19d4-48e8-8ec3-a644679475ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:31.623677 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1375359c-19d4-48e8-8ec3-a644679475ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:31.625733 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1375359c-19d4-48e8-8ec3-a644679475ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:31.626951 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-21acb342-7432-4e11-a7e3-5ad4747fb375 req-013caf60-352d-4460-ad33-2973b780ea8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ab710e-55b1-4cab-861c-4df85276e296", "tag": "af13f183-e203-48b0-88ea-6554e58e9b95"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:31.633376 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1375359c-19d4-48e8-8ec3-a644679475ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.313373 May 25 15:05:31.637048 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 404/819] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:31 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:31.651178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-21acb342-7432-4e11-a7e3-5ad4747fb375 req-013caf60-352d-4460-ad33-2973b780ea8a service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:31.652107 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-21acb342-7432-4e11-a7e3-5ad4747fb375 req-013caf60-352d-4460-ad33-2973b780ea8a service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:31.665599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-21acb342-7432-4e11-a7e3-5ad4747fb375 req-013caf60-352d-4460-ad33-2973b780ea8a service nova] Creating event network-changed:af13f183-e203-48b0-88ea-6554e58e9b95 for instance c0ab710e-55b1-4cab-861c-4df85276e296 on hv-cinder-80382 May 25 15:05:31.670494 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-21acb342-7432-4e11-a7e3-5ad4747fb375 req-013caf60-352d-4460-ad33-2973b780ea8a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048343 May 25 15:05:31.671660 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 416/820] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:05:31.998386 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0212c388-9579-4d1e-ab97-415dd33d5374 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:31.999040 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0212c388-9579-4d1e-ab97-415dd33d5374 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:32.006030 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0212c388-9579-4d1e-ab97-415dd33d5374 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:32.006492 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0212c388-9579-4d1e-ab97-415dd33d5374 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:32.007280 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0212c388-9579-4d1e-ab97-415dd33d5374 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:32.007720 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0212c388-9579-4d1e-ab97-415dd33d5374 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:32.200671 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-0212c388-9579-4d1e-ab97-415dd33d5374 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:32.210336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0212c388-9579-4d1e-ab97-415dd33d5374 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1359 microversion: 2.1 time: 0.216178 May 25 15:05:32.210909 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 405/821] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:31 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:32.653842 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d908763a-4d3f-43b7-8805-fdbdbd6f99e8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:32.654761 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d908763a-4d3f-43b7-8805-fdbdbd6f99e8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:32.662433 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d908763a-4d3f-43b7-8805-fdbdbd6f99e8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:32.662812 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d908763a-4d3f-43b7-8805-fdbdbd6f99e8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:32.663589 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d908763a-4d3f-43b7-8805-fdbdbd6f99e8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:32.665038 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d908763a-4d3f-43b7-8805-fdbdbd6f99e8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:32.841499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d908763a-4d3f-43b7-8805-fdbdbd6f99e8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:32.851238 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d908763a-4d3f-43b7-8805-fdbdbd6f99e8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:32.852807 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d908763a-4d3f-43b7-8805-fdbdbd6f99e8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:32.854205 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d908763a-4d3f-43b7-8805-fdbdbd6f99e8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.205095 May 25 15:05:32.855482 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 417/822] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:32 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:05:33.227952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-10ce1a04-2193-4403-8af0-a8679b8da100 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:33.228591 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-10ce1a04-2193-4403-8af0-a8679b8da100 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:33.240151 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-10ce1a04-2193-4403-8af0-a8679b8da100 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:33.240597 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-10ce1a04-2193-4403-8af0-a8679b8da100 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:33.241386 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-10ce1a04-2193-4403-8af0-a8679b8da100 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:33.241821 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-10ce1a04-2193-4403-8af0-a8679b8da100 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:33.399957 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-10ce1a04-2193-4403-8af0-a8679b8da100 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:33.407648 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-10ce1a04-2193-4403-8af0-a8679b8da100 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1359 microversion: 2.1 time: 0.184105 May 25 15:05:33.408218 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 406/823] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:33 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:33.872842 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-78702bfa-64a9-4ed8-988a-737a4f6e3a67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:33.873467 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-78702bfa-64a9-4ed8-988a-737a4f6e3a67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:33.880082 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-78702bfa-64a9-4ed8-988a-737a4f6e3a67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:33.880574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-78702bfa-64a9-4ed8-988a-737a4f6e3a67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:33.881311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-78702bfa-64a9-4ed8-988a-737a4f6e3a67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:33.881756 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-78702bfa-64a9-4ed8-988a-737a4f6e3a67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:34.031093 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-78702bfa-64a9-4ed8-988a-737a4f6e3a67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:34.039747 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-78702bfa-64a9-4ed8-988a-737a4f6e3a67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:34.041265 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-78702bfa-64a9-4ed8-988a-737a4f6e3a67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:34.042450 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-78702bfa-64a9-4ed8-988a-737a4f6e3a67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.173603 May 25 15:05:34.043027 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 418/824] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:33 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:34.426285 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-78a0d5c9-b136-4ae0-8cbc-9c3b60dfc66a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:34.427003 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-78a0d5c9-b136-4ae0-8cbc-9c3b60dfc66a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:34.433926 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-78a0d5c9-b136-4ae0-8cbc-9c3b60dfc66a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:34.434387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-78a0d5c9-b136-4ae0-8cbc-9c3b60dfc66a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:34.435174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-78a0d5c9-b136-4ae0-8cbc-9c3b60dfc66a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:34.435615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-78a0d5c9-b136-4ae0-8cbc-9c3b60dfc66a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:34.593461 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-78a0d5c9-b136-4ae0-8cbc-9c3b60dfc66a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:34.602453 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-78a0d5c9-b136-4ae0-8cbc-9c3b60dfc66a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1359 microversion: 2.1 time: 0.179128 May 25 15:05:34.603402 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 407/825] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:34 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:35.064278 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-05827dd4-5b0d-42d0-b3cd-16eb7ffb157f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:35.064894 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-05827dd4-5b0d-42d0-b3cd-16eb7ffb157f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:35.075381 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-05827dd4-5b0d-42d0-b3cd-16eb7ffb157f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:35.075847 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-05827dd4-5b0d-42d0-b3cd-16eb7ffb157f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:35.077078 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-05827dd4-5b0d-42d0-b3cd-16eb7ffb157f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:35.077675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-05827dd4-5b0d-42d0-b3cd-16eb7ffb157f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:35.233038 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-05827dd4-5b0d-42d0-b3cd-16eb7ffb157f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:35.242244 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-05827dd4-5b0d-42d0-b3cd-16eb7ffb157f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:35.243753 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-05827dd4-5b0d-42d0-b3cd-16eb7ffb157f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:35.244919 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-05827dd4-5b0d-42d0-b3cd-16eb7ffb157f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.186042 May 25 15:05:35.245478 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 419/826] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:35 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:35.620919 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-928b03d8-18ae-4183-8099-e9788846700b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:35.622554 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-928b03d8-18ae-4183-8099-e9788846700b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:35.630627 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-928b03d8-18ae-4183-8099-e9788846700b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:35.631608 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-928b03d8-18ae-4183-8099-e9788846700b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:35.632799 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-928b03d8-18ae-4183-8099-e9788846700b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:35.633525 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-928b03d8-18ae-4183-8099-e9788846700b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:35.787394 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-928b03d8-18ae-4183-8099-e9788846700b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:35.795234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-928b03d8-18ae-4183-8099-e9788846700b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1359 microversion: 2.1 time: 0.178443 May 25 15:05:35.795844 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 408/827] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:35 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:36.263962 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-acd105ed-3055-4562-b92c-f2d29ace4b61 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:36.264621 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-acd105ed-3055-4562-b92c-f2d29ace4b61 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:36.266789 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=2 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:36.267958 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=6 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:36.274433 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-acd105ed-3055-4562-b92c-f2d29ace4b61 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:36.274903 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-acd105ed-3055-4562-b92c-f2d29ace4b61 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:36.275766 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-acd105ed-3055-4562-b92c-f2d29ace4b61 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:36.276178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-acd105ed-3055-4562-b92c-f2d29ace4b61 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:36.459682 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-acd105ed-3055-4562-b92c-f2d29ace4b61 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:36.472644 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-acd105ed-3055-4562-b92c-f2d29ace4b61 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:36.474189 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-acd105ed-3055-4562-b92c-f2d29ace4b61 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:36.475461 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-acd105ed-3055-4562-b92c-f2d29ace4b61 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.215914 May 25 15:05:36.484778 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 420/828] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:36 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:36.819811 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-fd7a65b7-3a94-4a67-b809-5d2152ff26ca tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:36.822272 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-fd7a65b7-3a94-4a67-b809-5d2152ff26ca tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:36.830298 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=6 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:36.834706 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fd7a65b7-3a94-4a67-b809-5d2152ff26ca tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:36.835938 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fd7a65b7-3a94-4a67-b809-5d2152ff26ca tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:36.837020 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fd7a65b7-3a94-4a67-b809-5d2152ff26ca tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:36.837653 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fd7a65b7-3a94-4a67-b809-5d2152ff26ca tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:37.023120 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-fd7a65b7-3a94-4a67-b809-5d2152ff26ca tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:37.032650 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-fd7a65b7-3a94-4a67-b809-5d2152ff26ca tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1359 microversion: 2.1 time: 0.218830 May 25 15:05:37.034150 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 409/829] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:36 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:37.482366 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d16c2279-e55b-4781-94a7-280fb29dc0bf tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1127466657", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1083162931", "security_groups": [{"name": "tempest-secgroup-smoke-443150314"}], "networks": [{"uuid": "c84be869-0fb3-40e0-a0bf-430d84d35277"}], "block_device_mapping_v2": [{"uuid": "a57570f3-370a-4a8f-9e3a-67ba03147f47", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:37.504014 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-636ba959-9efe-40b2-989c-b18f0301ca53 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:37.504876 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-636ba959-9efe-40b2-989c-b18f0301ca53 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:37.520355 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-636ba959-9efe-40b2-989c-b18f0301ca53 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:37.520812 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-636ba959-9efe-40b2-989c-b18f0301ca53 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:37.521599 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-636ba959-9efe-40b2-989c-b18f0301ca53 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:37.522049 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-636ba959-9efe-40b2-989c-b18f0301ca53 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:37.677804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.network.neutron [None req-d16c2279-e55b-4781-94a7-280fb29dc0bf tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] validate_networks() for [('c84be869-0fb3-40e0-a0bf-430d84d35277', None, None, None, None, None)] {{(pid=124523) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:05:37.715440 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-636ba959-9efe-40b2-989c-b18f0301ca53 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:37.724695 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-636ba959-9efe-40b2-989c-b18f0301ca53 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:37.726225 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-636ba959-9efe-40b2-989c-b18f0301ca53 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:37.727429 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-636ba959-9efe-40b2-989c-b18f0301ca53 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.235685 May 25 15:05:37.727984 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 410/830] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:37 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:38.051534 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-9cd554fe-5f96-4dc7-a2f9-75a6323dd194 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:38.052271 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-9cd554fe-5f96-4dc7-a2f9-75a6323dd194 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:38.059072 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9cd554fe-5f96-4dc7-a2f9-75a6323dd194 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:38.059610 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9cd554fe-5f96-4dc7-a2f9-75a6323dd194 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:38.060463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9cd554fe-5f96-4dc7-a2f9-75a6323dd194 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:38.060903 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9cd554fe-5f96-4dc7-a2f9-75a6323dd194 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:38.126855 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-d16c2279-e55b-4781-94a7-280fb29dc0bf tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Flavor limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:05:38.127284 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-d16c2279-e55b-4781-94a7-280fb29dc0bf tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Image limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:05:38.127768 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-d16c2279-e55b-4781-94a7-280fb29dc0bf tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Flavor pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:05:38.128220 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-d16c2279-e55b-4781-94a7-280fb29dc0bf tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Image pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:05:38.128637 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-d16c2279-e55b-4781-94a7-280fb29dc0bf tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:05:38.139871 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d16c2279-e55b-4781-94a7-280fb29dc0bf tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:38.140329 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d16c2279-e55b-4781-94a7-280fb29dc0bf tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:38.141137 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d16c2279-e55b-4781-94a7-280fb29dc0bf tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:38.143087 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d16c2279-e55b-4781-94a7-280fb29dc0bf tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:38.162112 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-d16c2279-e55b-4781-94a7-280fb29dc0bf tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Getting quotas for project ffb2008af6964bc5b2e94a630bfe78e5. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:05:38.166991 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-d16c2279-e55b-4781-94a7-280fb29dc0bf tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Getting quotas for user 9c1bf697f0fd4e2cbc8d52cec772e446 and project ffb2008af6964bc5b2e94a630bfe78e5. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:05:38.229043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-9cd554fe-5f96-4dc7-a2f9-75a6323dd194 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:38.233035 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d16c2279-e55b-4781-94a7-280fb29dc0bf tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Going to run 1 instances... {{(pid=124523) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:05:38.235132 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d16c2279-e55b-4781-94a7-280fb29dc0bf tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a57570f3-370a-4a8f-9e3a-67ba03147f47',volume_size=None,volume_type=None)] {{(pid=124523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:05:38.237647 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-9cd554fe-5f96-4dc7-a2f9-75a6323dd194 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1359 microversion: 2.1 time: 0.190675 May 25 15:05:38.239151 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 411/831] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:38 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:05:38.368018 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d16c2279-e55b-4781-94a7-280fb29dc0bf tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.889486 May 25 15:05:38.368653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 421/832] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 15:05:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:05:38.378696 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-bc98d935-9d08-40ac-b726-14d35228efc2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:38.379314 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-bc98d935-9d08-40ac-b726-14d35228efc2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:38.382487 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:38.434849 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-bc98d935-9d08-40ac-b726-14d35228efc2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:38.441824 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-bc98d935-9d08-40ac-b726-14d35228efc2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1089 microversion: 2.1 time: 0.067060 May 25 15:05:38.442446 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 412/833] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:38 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:38.745248 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2cfce62c-cbbb-4f2f-b413-a8c940fcdf57 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:38.746003 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2cfce62c-cbbb-4f2f-b413-a8c940fcdf57 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:38.753522 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2cfce62c-cbbb-4f2f-b413-a8c940fcdf57 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:38.753976 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2cfce62c-cbbb-4f2f-b413-a8c940fcdf57 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:38.754789 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2cfce62c-cbbb-4f2f-b413-a8c940fcdf57 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:38.755231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2cfce62c-cbbb-4f2f-b413-a8c940fcdf57 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:38.896996 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2cfce62c-cbbb-4f2f-b413-a8c940fcdf57 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:38.905922 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2cfce62c-cbbb-4f2f-b413-a8c940fcdf57 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:38.908081 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2cfce62c-cbbb-4f2f-b413-a8c940fcdf57 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:38.909195 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2cfce62c-cbbb-4f2f-b413-a8c940fcdf57 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.168527 May 25 15:05:38.909999 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 422/834] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:38 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:39.257374 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-ceb243e0-78bf-4503-8551-5d807f144358 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:39.257954 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-ceb243e0-78bf-4503-8551-5d807f144358 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:39.265076 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ceb243e0-78bf-4503-8551-5d807f144358 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:39.265617 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ceb243e0-78bf-4503-8551-5d807f144358 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:39.266452 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ceb243e0-78bf-4503-8551-5d807f144358 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:39.266895 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-ceb243e0-78bf-4503-8551-5d807f144358 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:39.411693 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-ceb243e0-78bf-4503-8551-5d807f144358 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:39.424876 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-ceb243e0-78bf-4503-8551-5d807f144358 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1359 microversion: 2.1 time: 0.171505 May 25 15:05:39.425486 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 413/835] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:39 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:39.461150 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e77602dc-37f3-44b8-9228-93ce21b189e1 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:39.462092 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e77602dc-37f3-44b8-9228-93ce21b189e1 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:39.472741 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e77602dc-37f3-44b8-9228-93ce21b189e1 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:39.473276 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e77602dc-37f3-44b8-9228-93ce21b189e1 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:39.475281 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e77602dc-37f3-44b8-9228-93ce21b189e1 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:39.476170 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e77602dc-37f3-44b8-9228-93ce21b189e1 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:39.582426 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e77602dc-37f3-44b8-9228-93ce21b189e1 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:39.590776 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e77602dc-37f3-44b8-9228-93ce21b189e1 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1131 microversion: 2.1 time: 0.134994 May 25 15:05:39.603235 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 423/836] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:39 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1131 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:39.804227 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-6f405dbf-d9bd-47c1-baca-284ecbd840eb req-d56a3a9f-9d45-4ac8-800f-b1bd5c2df109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aef5cf9-818a-4b1b-8305-258790e3845d", "tag": "14bd1814-6415-4936-8dc1-ab3f7060d8b1"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:39.812858 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-6f405dbf-d9bd-47c1-baca-284ecbd840eb req-d56a3a9f-9d45-4ac8-800f-b1bd5c2df109 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:39.813301 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-6f405dbf-d9bd-47c1-baca-284ecbd840eb req-d56a3a9f-9d45-4ac8-800f-b1bd5c2df109 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:39.830489 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-6f405dbf-d9bd-47c1-baca-284ecbd840eb req-d56a3a9f-9d45-4ac8-800f-b1bd5c2df109 service nova] Creating event network-changed:14bd1814-6415-4936-8dc1-ab3f7060d8b1 for instance 5aef5cf9-818a-4b1b-8305-258790e3845d on hv-cinder-80382 May 25 15:05:39.836248 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-6f405dbf-d9bd-47c1-baca-284ecbd840eb req-d56a3a9f-9d45-4ac8-800f-b1bd5c2df109 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035609 May 25 15:05:39.836866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 414/837] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:05:39.927164 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e1825ba8-5dd8-4718-a2c4-9d5f2eac94ba tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:39.927781 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e1825ba8-5dd8-4718-a2c4-9d5f2eac94ba tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:39.936356 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e1825ba8-5dd8-4718-a2c4-9d5f2eac94ba tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:39.936805 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e1825ba8-5dd8-4718-a2c4-9d5f2eac94ba tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:39.937569 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e1825ba8-5dd8-4718-a2c4-9d5f2eac94ba tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:39.938241 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e1825ba8-5dd8-4718-a2c4-9d5f2eac94ba tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:40.151248 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e1825ba8-5dd8-4718-a2c4-9d5f2eac94ba tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:40.161562 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e1825ba8-5dd8-4718-a2c4-9d5f2eac94ba tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:40.163566 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e1825ba8-5dd8-4718-a2c4-9d5f2eac94ba tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:40.165002 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e1825ba8-5dd8-4718-a2c4-9d5f2eac94ba tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.241750 May 25 15:05:40.165943 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 424/838] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:39 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:40.443925 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-9dd52db4-7bfc-45e8-80d2-9ad4af598b05 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:40.444553 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-9dd52db4-7bfc-45e8-80d2-9ad4af598b05 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:40.450992 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9dd52db4-7bfc-45e8-80d2-9ad4af598b05 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:40.451437 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9dd52db4-7bfc-45e8-80d2-9ad4af598b05 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:40.452197 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9dd52db4-7bfc-45e8-80d2-9ad4af598b05 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:40.452716 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9dd52db4-7bfc-45e8-80d2-9ad4af598b05 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:40.608415 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-bb719124-d23c-4ec1-bb00-ac60f0940a08 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:40.609315 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-bb719124-d23c-4ec1-bb00-ac60f0940a08 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:40.616999 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bb719124-d23c-4ec1-bb00-ac60f0940a08 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:40.617432 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bb719124-d23c-4ec1-bb00-ac60f0940a08 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:40.618500 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bb719124-d23c-4ec1-bb00-ac60f0940a08 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:40.618950 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bb719124-d23c-4ec1-bb00-ac60f0940a08 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:40.728381 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-bb719124-d23c-4ec1-bb00-ac60f0940a08 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:40.736773 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-bb719124-d23c-4ec1-bb00-ac60f0940a08 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1205 microversion: 2.1 time: 0.132179 May 25 15:05:40.737532 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 425/839] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:40 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1205 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:05:40.911033 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-9dd52db4-7bfc-45e8-80d2-9ad4af598b05 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:40.918791 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-9dd52db4-7bfc-45e8-80d2-9ad4af598b05 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1359 microversion: 2.1 time: 0.480431 May 25 15:05:40.919256 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 415/840] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:40 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1359 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:41.184552 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3c78542b-ef6e-43c1-af12-d01f641d5537 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:41.185161 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-3c78542b-ef6e-43c1-af12-d01f641d5537 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:41.191277 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3c78542b-ef6e-43c1-af12-d01f641d5537 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:41.191726 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3c78542b-ef6e-43c1-af12-d01f641d5537 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:41.192498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3c78542b-ef6e-43c1-af12-d01f641d5537 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:41.192929 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3c78542b-ef6e-43c1-af12-d01f641d5537 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:41.482439 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-3c78542b-ef6e-43c1-af12-d01f641d5537 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:41.491946 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-3c78542b-ef6e-43c1-af12-d01f641d5537 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:41.493455 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-3c78542b-ef6e-43c1-af12-d01f641d5537 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:41.494647 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3c78542b-ef6e-43c1-af12-d01f641d5537 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1809 microversion: 2.20 time: 0.314508 May 25 15:05:41.495206 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 426/841] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:41 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1809 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:41.755715 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-3fe5bb8f-4930-47cb-a1ca-33cf20f0fbf2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:41.756483 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-3fe5bb8f-4930-47cb-a1ca-33cf20f0fbf2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:41.764087 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3fe5bb8f-4930-47cb-a1ca-33cf20f0fbf2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:41.764847 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3fe5bb8f-4930-47cb-a1ca-33cf20f0fbf2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:41.765737 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3fe5bb8f-4930-47cb-a1ca-33cf20f0fbf2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:41.766257 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3fe5bb8f-4930-47cb-a1ca-33cf20f0fbf2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:41.842863 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3fe5bb8f-4930-47cb-a1ca-33cf20f0fbf2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:41.852192 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-3fe5bb8f-4930-47cb-a1ca-33cf20f0fbf2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1205 microversion: 2.1 time: 0.101945 May 25 15:05:41.862372 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 416/842] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:41 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1205 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:41.936435 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-fdd62d76-f2dd-4881-b520-f43bcd445783 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:41.937054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-fdd62d76-f2dd-4881-b520-f43bcd445783 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:41.947167 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fdd62d76-f2dd-4881-b520-f43bcd445783 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:41.947951 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fdd62d76-f2dd-4881-b520-f43bcd445783 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:41.948972 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fdd62d76-f2dd-4881-b520-f43bcd445783 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:41.949421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fdd62d76-f2dd-4881-b520-f43bcd445783 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:42.210052 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-fdd62d76-f2dd-4881-b520-f43bcd445783 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:42.223521 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-fdd62d76-f2dd-4881-b520-f43bcd445783 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1359 microversion: 2.1 time: 0.290906 May 25 15:05:42.224351 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 427/843] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:41 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1359 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:42.513766 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1bf650e6-42ca-4070-8ef2-c71f5f5f830e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:42.514433 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1bf650e6-42ca-4070-8ef2-c71f5f5f830e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:42.521643 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1bf650e6-42ca-4070-8ef2-c71f5f5f830e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:42.522203 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1bf650e6-42ca-4070-8ef2-c71f5f5f830e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:42.522999 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1bf650e6-42ca-4070-8ef2-c71f5f5f830e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:42.523498 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1bf650e6-42ca-4070-8ef2-c71f5f5f830e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:42.528741 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=100 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:42.664686 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1bf650e6-42ca-4070-8ef2-c71f5f5f830e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:42.673850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1bf650e6-42ca-4070-8ef2-c71f5f5f830e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:42.676217 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1bf650e6-42ca-4070-8ef2-c71f5f5f830e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:42.677802 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1bf650e6-42ca-4070-8ef2-c71f5f5f830e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1796 microversion: 2.20 time: 0.168229 May 25 15:05:42.678394 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 417/844] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:05:42 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1796 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:05:42.870863 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4a6bc17a-b676-431e-98c1-7bf1ac739d77 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:42.871769 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4a6bc17a-b676-431e-98c1-7bf1ac739d77 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:42.880358 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4a6bc17a-b676-431e-98c1-7bf1ac739d77 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:42.880944 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4a6bc17a-b676-431e-98c1-7bf1ac739d77 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:42.881840 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4a6bc17a-b676-431e-98c1-7bf1ac739d77 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:42.882465 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4a6bc17a-b676-431e-98c1-7bf1ac739d77 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:43.096071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4a6bc17a-b676-431e-98c1-7bf1ac739d77 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:43.105233 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4a6bc17a-b676-431e-98c1-7bf1ac739d77 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1260 microversion: 2.1 time: 0.238901 May 25 15:05:43.106058 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 428/845] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:42 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:43.155861 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-486cc59b-665d-4ad8-8ce7-5e1d2c2249cd req-a7861c8f-4f43-4647-be73-f6e9a582beec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3433ac-9290-4294-83ad-1fa030982ca5", "tag": "d91fb4f2-8eda-4755-a625-3d06bee0b78d"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:43.166810 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-486cc59b-665d-4ad8-8ce7-5e1d2c2249cd req-a7861c8f-4f43-4647-be73-f6e9a582beec service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:43.167177 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-486cc59b-665d-4ad8-8ce7-5e1d2c2249cd req-a7861c8f-4f43-4647-be73-f6e9a582beec service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:43.180044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-486cc59b-665d-4ad8-8ce7-5e1d2c2249cd req-a7861c8f-4f43-4647-be73-f6e9a582beec service nova] Creating event network-changed:d91fb4f2-8eda-4755-a625-3d06bee0b78d for instance dc3433ac-9290-4294-83ad-1fa030982ca5 on hv-cinder-80382 May 25 15:05:43.185411 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-486cc59b-665d-4ad8-8ce7-5e1d2c2249cd req-a7861c8f-4f43-4647-be73-f6e9a582beec service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033884 May 25 15:05:43.186086 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 418/846] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:05:43.241647 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-22b1e60d-5558-4a5c-a716-a41a0ba9aff7 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:43.242298 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-22b1e60d-5558-4a5c-a716-a41a0ba9aff7 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:43.249502 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-22b1e60d-5558-4a5c-a716-a41a0ba9aff7 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:43.249953 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-22b1e60d-5558-4a5c-a716-a41a0ba9aff7 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:43.250749 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-22b1e60d-5558-4a5c-a716-a41a0ba9aff7 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:43.251746 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-22b1e60d-5558-4a5c-a716-a41a0ba9aff7 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:43.254720 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=100 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:43.385892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-22b1e60d-5558-4a5c-a716-a41a0ba9aff7 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:43.393474 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-22b1e60d-5558-4a5c-a716-a41a0ba9aff7 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1359 microversion: 2.1 time: 0.156312 May 25 15:05:43.394251 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 429/847] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:43 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:44.124853 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a6de65dd-56ad-49b5-9463-2e502f6bd9c3 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:44.125596 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-a6de65dd-56ad-49b5-9463-2e502f6bd9c3 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:44.132281 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a6de65dd-56ad-49b5-9463-2e502f6bd9c3 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:44.132999 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a6de65dd-56ad-49b5-9463-2e502f6bd9c3 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:44.133800 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a6de65dd-56ad-49b5-9463-2e502f6bd9c3 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:44.134273 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a6de65dd-56ad-49b5-9463-2e502f6bd9c3 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:44.274498 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-a6de65dd-56ad-49b5-9463-2e502f6bd9c3 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:44.290816 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-a6de65dd-56ad-49b5-9463-2e502f6bd9c3 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1260 microversion: 2.1 time: 0.171156 May 25 15:05:44.291416 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 419/848] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:44 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:44.410375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-7046e466-b2ca-4b7f-9f46-7067726b64bb tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:44.411241 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-7046e466-b2ca-4b7f-9f46-7067726b64bb tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:44.418381 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7046e466-b2ca-4b7f-9f46-7067726b64bb tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:44.418836 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7046e466-b2ca-4b7f-9f46-7067726b64bb tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:44.419640 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7046e466-b2ca-4b7f-9f46-7067726b64bb tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:44.420083 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7046e466-b2ca-4b7f-9f46-7067726b64bb tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:44.664767 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-7046e466-b2ca-4b7f-9f46-7067726b64bb tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:44.672386 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-7046e466-b2ca-4b7f-9f46-7067726b64bb tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1359 microversion: 2.1 time: 0.265964 May 25 15:05:44.673537 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 430/849] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:44 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1359 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:45.309345 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8e82b893-1913-49d6-902a-f733c41f04a9 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:45.309954 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-8e82b893-1913-49d6-902a-f733c41f04a9 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:45.317223 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8e82b893-1913-49d6-902a-f733c41f04a9 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:45.317667 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8e82b893-1913-49d6-902a-f733c41f04a9 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:45.318497 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8e82b893-1913-49d6-902a-f733c41f04a9 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:45.318936 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8e82b893-1913-49d6-902a-f733c41f04a9 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:45.473390 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-8e82b893-1913-49d6-902a-f733c41f04a9 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:45.481594 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-8e82b893-1913-49d6-902a-f733c41f04a9 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1260 microversion: 2.1 time: 0.176070 May 25 15:05:45.482335 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 420/850] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:45 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:45.690998 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-af9fe08c-264c-43d8-980b-99b4181a631a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:45.691620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-af9fe08c-264c-43d8-980b-99b4181a631a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:45.698236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-af9fe08c-264c-43d8-980b-99b4181a631a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:45.698684 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-af9fe08c-264c-43d8-980b-99b4181a631a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:45.699437 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-af9fe08c-264c-43d8-980b-99b4181a631a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:45.699864 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-af9fe08c-264c-43d8-980b-99b4181a631a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:45.838875 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-af9fe08c-264c-43d8-980b-99b4181a631a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:45.847015 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-af9fe08c-264c-43d8-980b-99b4181a631a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1359 microversion: 2.1 time: 0.160922 May 25 15:05:45.847589 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 431/851] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:45 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:46.499391 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-369214e0-9d0b-47e8-b219-0aee8dd2f33d tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:46.500008 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-369214e0-9d0b-47e8-b219-0aee8dd2f33d tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:46.507188 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-369214e0-9d0b-47e8-b219-0aee8dd2f33d tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:46.507640 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-369214e0-9d0b-47e8-b219-0aee8dd2f33d tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:46.508485 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-369214e0-9d0b-47e8-b219-0aee8dd2f33d tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:46.508930 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-369214e0-9d0b-47e8-b219-0aee8dd2f33d tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:46.648567 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-369214e0-9d0b-47e8-b219-0aee8dd2f33d tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:46.656473 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-369214e0-9d0b-47e8-b219-0aee8dd2f33d tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1260 microversion: 2.1 time: 0.161007 May 25 15:05:46.657047 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 421/852] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:46 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:46.864079 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-c9ca3b59-667d-4d6b-8f5f-655f6c6406be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:46.864654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-c9ca3b59-667d-4d6b-8f5f-655f6c6406be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:46.871239 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c9ca3b59-667d-4d6b-8f5f-655f6c6406be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:46.871730 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c9ca3b59-667d-4d6b-8f5f-655f6c6406be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:46.872504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c9ca3b59-667d-4d6b-8f5f-655f6c6406be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:46.872943 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c9ca3b59-667d-4d6b-8f5f-655f6c6406be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:47.003740 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-c9ca3b59-667d-4d6b-8f5f-655f6c6406be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:47.011421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-c9ca3b59-667d-4d6b-8f5f-655f6c6406be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1359 microversion: 2.1 time: 0.151418 May 25 15:05:47.011986 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 432/853] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:46 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:47.540878 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-5db4ba98-081f-4d62-89d5-0063841bac5a req-85c2a963-d6c5-4f19-84c5-34ecc810ab11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aef5cf9-818a-4b1b-8305-258790e3845d", "name": "network-vif-plugged", "status": "completed", "tag": "14bd1814-6415-4936-8dc1-ab3f7060d8b1"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:47.550164 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-5db4ba98-081f-4d62-89d5-0063841bac5a req-85c2a963-d6c5-4f19-84c5-34ecc810ab11 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:47.550609 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-5db4ba98-081f-4d62-89d5-0063841bac5a req-85c2a963-d6c5-4f19-84c5-34ecc810ab11 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:47.562084 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-5db4ba98-081f-4d62-89d5-0063841bac5a req-85c2a963-d6c5-4f19-84c5-34ecc810ab11 service nova] Creating event network-vif-plugged:14bd1814-6415-4936-8dc1-ab3f7060d8b1 for instance 5aef5cf9-818a-4b1b-8305-258790e3845d on hv-cinder-80382 May 25 15:05:47.567650 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-5db4ba98-081f-4d62-89d5-0063841bac5a req-85c2a963-d6c5-4f19-84c5-34ecc810ab11 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030519 May 25 15:05:47.568301 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 422/854] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:05:47.672769 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-22f08210-ea0b-4e73-b46f-3aba47bf7373 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:47.673496 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-22f08210-ea0b-4e73-b46f-3aba47bf7373 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:47.680086 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-22f08210-ea0b-4e73-b46f-3aba47bf7373 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:47.680750 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-22f08210-ea0b-4e73-b46f-3aba47bf7373 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:47.681737 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-22f08210-ea0b-4e73-b46f-3aba47bf7373 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:47.682412 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-22f08210-ea0b-4e73-b46f-3aba47bf7373 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:47.870866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-22f08210-ea0b-4e73-b46f-3aba47bf7373 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:47.879049 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-22f08210-ea0b-4e73-b46f-3aba47bf7373 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1260 microversion: 2.1 time: 0.210186 May 25 15:05:47.879622 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 433/855] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:47 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:48.029248 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7e1afcbf-7b9b-40b5-b9d6-00d2e36816fc tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:48.029948 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7e1afcbf-7b9b-40b5-b9d6-00d2e36816fc tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:48.036764 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7e1afcbf-7b9b-40b5-b9d6-00d2e36816fc tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:48.037206 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7e1afcbf-7b9b-40b5-b9d6-00d2e36816fc tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:48.037962 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7e1afcbf-7b9b-40b5-b9d6-00d2e36816fc tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:48.038415 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7e1afcbf-7b9b-40b5-b9d6-00d2e36816fc tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:48.168160 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7e1afcbf-7b9b-40b5-b9d6-00d2e36816fc tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:48.175601 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7e1afcbf-7b9b-40b5-b9d6-00d2e36816fc tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1359 microversion: 2.1 time: 0.150599 May 25 15:05:48.176200 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 423/856] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:48 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:48.896521 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e13ef5bf-d7c6-403e-9c62-aee7b2d8ee47 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:48.897349 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e13ef5bf-d7c6-403e-9c62-aee7b2d8ee47 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:48.899305 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=2 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:48.900011 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=6 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:48.906847 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e13ef5bf-d7c6-403e-9c62-aee7b2d8ee47 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:48.907159 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e13ef5bf-d7c6-403e-9c62-aee7b2d8ee47 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:48.907943 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e13ef5bf-d7c6-403e-9c62-aee7b2d8ee47 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:48.908384 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e13ef5bf-d7c6-403e-9c62-aee7b2d8ee47 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:49.046150 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e13ef5bf-d7c6-403e-9c62-aee7b2d8ee47 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:49.053863 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e13ef5bf-d7c6-403e-9c62-aee7b2d8ee47 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1260 microversion: 2.1 time: 0.161212 May 25 15:05:49.054505 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 434/857] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:48 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:49.192649 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d427c28c-2de8-4c06-a904-2109b92401be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:49.193176 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d427c28c-2de8-4c06-a904-2109b92401be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:49.196225 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:49.203007 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d427c28c-2de8-4c06-a904-2109b92401be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:49.203574 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d427c28c-2de8-4c06-a904-2109b92401be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:49.204744 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d427c28c-2de8-4c06-a904-2109b92401be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:49.205178 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d427c28c-2de8-4c06-a904-2109b92401be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:49.354624 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d427c28c-2de8-4c06-a904-2109b92401be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:49.363162 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d427c28c-2de8-4c06-a904-2109b92401be tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1359 microversion: 2.1 time: 0.174400 May 25 15:05:49.363750 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 424/858] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:49 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:50.070589 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-6eb98784-9cb6-425f-87dd-97220d2825ed tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:50.071192 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-6eb98784-9cb6-425f-87dd-97220d2825ed tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:50.077875 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6eb98784-9cb6-425f-87dd-97220d2825ed tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:50.078357 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6eb98784-9cb6-425f-87dd-97220d2825ed tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:50.079749 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6eb98784-9cb6-425f-87dd-97220d2825ed tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:50.080203 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6eb98784-9cb6-425f-87dd-97220d2825ed tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:50.242818 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-6eb98784-9cb6-425f-87dd-97220d2825ed tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:50.250891 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-6eb98784-9cb6-425f-87dd-97220d2825ed tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1260 microversion: 2.1 time: 0.184077 May 25 15:05:50.251511 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 435/859] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:50 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:50.382988 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-9fd400e9-9197-4480-83e5-3d2081d1fa44 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:50.383650 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-9fd400e9-9197-4480-83e5-3d2081d1fa44 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:50.391078 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9fd400e9-9197-4480-83e5-3d2081d1fa44 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:50.391528 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9fd400e9-9197-4480-83e5-3d2081d1fa44 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:50.392305 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9fd400e9-9197-4480-83e5-3d2081d1fa44 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:50.392774 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9fd400e9-9197-4480-83e5-3d2081d1fa44 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:50.526352 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-9fd400e9-9197-4480-83e5-3d2081d1fa44 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:50.534671 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-9fd400e9-9197-4480-83e5-3d2081d1fa44 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1548 microversion: 2.1 time: 0.155820 May 25 15:05:50.535242 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 425/860] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:50 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:50.551382 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-19db27d4-02c3-4671-b9b4-284275db8d32 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:50.551987 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-19db27d4-02c3-4671-b9b4-284275db8d32 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:50.557954 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-19db27d4-02c3-4671-b9b4-284275db8d32 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:50.558433 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-19db27d4-02c3-4671-b9b4-284275db8d32 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:50.559206 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-19db27d4-02c3-4671-b9b4-284275db8d32 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:50.559632 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-19db27d4-02c3-4671-b9b4-284275db8d32 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:50.695946 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-19db27d4-02c3-4671-b9b4-284275db8d32 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:50.703591 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-19db27d4-02c3-4671-b9b4-284275db8d32 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1548 microversion: 2.1 time: 0.156518 May 25 15:05:50.704147 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 436/861] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:50 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:50.720128 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-937dcbde-5f52-4ed8-8928-3493f686adfd tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:50.723567 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-937dcbde-5f52-4ed8-8928-3493f686adfd tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:50.724373 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-937dcbde-5f52-4ed8-8928-3493f686adfd tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Searching by: {'deleted': False, 'project_id': '5e9e55701e7c4fe180a21d1934298240'} {{(pid=124524) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 25 15:05:50.731011 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-937dcbde-5f52-4ed8-8928-3493f686adfd tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:50.731461 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-937dcbde-5f52-4ed8-8928-3493f686adfd tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:50.732251 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-937dcbde-5f52-4ed8-8928-3493f686adfd tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:50.732687 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-937dcbde-5f52-4ed8-8928-3493f686adfd tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:50.820461 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.multi_cell_list [None req-937dcbde-5f52-4ed8-8928-3493f686adfd tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 25 15:05:50.917267 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-937dcbde-5f52-4ed8-8928-3493f686adfd tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.201352 May 25 15:05:50.918238 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 426/862] 10.222.0.78 () {58 vars in 1124 bytes} [Wed May 25 15:05:50 2022] GET /compute/v2.1/servers => generated 343 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:05:50.928747 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-6fbde8cb-bf75-4422-8993-c48e58d3943b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:50.929365 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-6fbde8cb-bf75-4422-8993-c48e58d3943b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:50.935495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6fbde8cb-bf75-4422-8993-c48e58d3943b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:50.935945 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6fbde8cb-bf75-4422-8993-c48e58d3943b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:50.936717 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6fbde8cb-bf75-4422-8993-c48e58d3943b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:50.937152 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6fbde8cb-bf75-4422-8993-c48e58d3943b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:51.065467 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-6fbde8cb-bf75-4422-8993-c48e58d3943b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:51.073012 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-6fbde8cb-bf75-4422-8993-c48e58d3943b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1548 microversion: 2.1 time: 0.148146 May 25 15:05:51.073644 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 437/863] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:50 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:05:51.270583 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-619d0224-7d2f-4f61-beba-34f4e6002423 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:51.271172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-619d0224-7d2f-4f61-beba-34f4e6002423 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:51.277218 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-619d0224-7d2f-4f61-beba-34f4e6002423 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:51.277769 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-619d0224-7d2f-4f61-beba-34f4e6002423 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:51.278511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-619d0224-7d2f-4f61-beba-34f4e6002423 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:51.278956 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-619d0224-7d2f-4f61-beba-34f4e6002423 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:51.437764 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-619d0224-7d2f-4f61-beba-34f4e6002423 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:51.446884 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-619d0224-7d2f-4f61-beba-34f4e6002423 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1260 microversion: 2.1 time: 0.180633 May 25 15:05:51.447493 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 427/864] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:51 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:52.464502 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f698c430-0a1d-4985-b689-1028f74ee080 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:52.465118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f698c430-0a1d-4985-b689-1028f74ee080 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:52.472570 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f698c430-0a1d-4985-b689-1028f74ee080 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:52.473009 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f698c430-0a1d-4985-b689-1028f74ee080 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:52.473786 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f698c430-0a1d-4985-b689-1028f74ee080 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:52.474258 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f698c430-0a1d-4985-b689-1028f74ee080 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:52.608564 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-f9fab890-021f-452d-bde0-bb709a07907d tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c53616dc-e315-4135-b278-a14e5146f143"}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:52.609655 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-f9fab890-021f-452d-bde0-bb709a07907d tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:52.616875 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f9fab890-021f-452d-bde0-bb709a07907d tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:52.617347 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f9fab890-021f-452d-bde0-bb709a07907d tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:52.617745 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f698c430-0a1d-4985-b689-1028f74ee080 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:52.618142 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f9fab890-021f-452d-bde0-bb709a07907d tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:52.618570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f9fab890-021f-452d-bde0-bb709a07907d tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:52.625346 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f698c430-0a1d-4985-b689-1028f74ee080 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1260 microversion: 2.1 time: 0.165073 May 25 15:05:52.626515 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 438/865] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:52 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:52.971328 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-f9fab890-021f-452d-bde0-bb709a07907d tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "POST /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.366634 May 25 15:05:52.971944 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 428/866] 10.222.0.78 () {60 vars in 1322 bytes} [Wed May 25 15:05:52 2022] POST /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:05:53.643489 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-dea840bc-3712-456c-a701-76dd1262ac6a tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:53.645041 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-dea840bc-3712-456c-a701-76dd1262ac6a tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:53.652198 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dea840bc-3712-456c-a701-76dd1262ac6a tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:53.653059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dea840bc-3712-456c-a701-76dd1262ac6a tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:53.653440 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dea840bc-3712-456c-a701-76dd1262ac6a tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:53.653886 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dea840bc-3712-456c-a701-76dd1262ac6a tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:53.790397 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-dea840bc-3712-456c-a701-76dd1262ac6a tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:53.799017 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-dea840bc-3712-456c-a701-76dd1262ac6a tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1260 microversion: 2.1 time: 0.159974 May 25 15:05:53.799670 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 439/867] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:53 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:54.817873 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-dd389732-87a8-4e91-bfb7-c32a64436f3a tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:54.818607 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-dd389732-87a8-4e91-bfb7-c32a64436f3a tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:54.825341 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dd389732-87a8-4e91-bfb7-c32a64436f3a tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:54.825894 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dd389732-87a8-4e91-bfb7-c32a64436f3a tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:54.826626 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dd389732-87a8-4e91-bfb7-c32a64436f3a tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:54.827067 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dd389732-87a8-4e91-bfb7-c32a64436f3a tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:54.962497 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-dd389732-87a8-4e91-bfb7-c32a64436f3a tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:54.970931 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-dd389732-87a8-4e91-bfb7-c32a64436f3a tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1260 microversion: 2.1 time: 0.158418 May 25 15:05:54.971524 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 429/868] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:54 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:05:55.588619 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-9f5b1e00-bd78-446c-954c-150d95f3bb11 req-16e4a9a8-d980-4dbe-b329-ca38268726fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3433ac-9290-4294-83ad-1fa030982ca5", "name": "network-vif-plugged", "status": "completed", "tag": "d91fb4f2-8eda-4755-a625-3d06bee0b78d"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:55.599524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-9f5b1e00-bd78-446c-954c-150d95f3bb11 req-16e4a9a8-d980-4dbe-b329-ca38268726fb service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:55.600227 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-9f5b1e00-bd78-446c-954c-150d95f3bb11 req-16e4a9a8-d980-4dbe-b329-ca38268726fb service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:55.616988 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-9f5b1e00-bd78-446c-954c-150d95f3bb11 req-16e4a9a8-d980-4dbe-b329-ca38268726fb service nova] Creating event network-vif-plugged:d91fb4f2-8eda-4755-a625-3d06bee0b78d for instance dc3433ac-9290-4294-83ad-1fa030982ca5 on hv-cinder-80382 May 25 15:05:55.622957 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-9f5b1e00-bd78-446c-954c-150d95f3bb11 req-16e4a9a8-d980-4dbe-b329-ca38268726fb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037889 May 25 15:05:55.624578 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 440/869] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:05:55.987719 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6dff5a8e-3df1-4014-aad8-fed4c3589029 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:55.988433 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6dff5a8e-3df1-4014-aad8-fed4c3589029 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:55.995463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6dff5a8e-3df1-4014-aad8-fed4c3589029 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:55.995987 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6dff5a8e-3df1-4014-aad8-fed4c3589029 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:55.996856 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6dff5a8e-3df1-4014-aad8-fed4c3589029 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:55.997372 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6dff5a8e-3df1-4014-aad8-fed4c3589029 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:56.148969 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6dff5a8e-3df1-4014-aad8-fed4c3589029 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:56.158788 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6dff5a8e-3df1-4014-aad8-fed4c3589029 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1260 microversion: 2.1 time: 0.174572 May 25 15:05:56.159483 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 430/870] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:55 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:05:57.175964 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e173f2f2-8468-4009-b45f-e4d02a242e4c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:57.176563 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e173f2f2-8468-4009-b45f-e4d02a242e4c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:57.183521 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e173f2f2-8468-4009-b45f-e4d02a242e4c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:57.183959 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e173f2f2-8468-4009-b45f-e4d02a242e4c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:57.184727 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e173f2f2-8468-4009-b45f-e4d02a242e4c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:57.185156 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e173f2f2-8468-4009-b45f-e4d02a242e4c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:57.326347 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e173f2f2-8468-4009-b45f-e4d02a242e4c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:57.337179 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e173f2f2-8468-4009-b45f-e4d02a242e4c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1260 microversion: 2.1 time: 0.164297 May 25 15:05:57.337942 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 441/871] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:57 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:58.355423 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-669ec755-adcd-40c7-9e04-2aa2bd7cb9a8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:58.356029 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-669ec755-adcd-40c7-9e04-2aa2bd7cb9a8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:58.363210 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-669ec755-adcd-40c7-9e04-2aa2bd7cb9a8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:58.363784 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-669ec755-adcd-40c7-9e04-2aa2bd7cb9a8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:58.364595 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-669ec755-adcd-40c7-9e04-2aa2bd7cb9a8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:58.365030 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-669ec755-adcd-40c7-9e04-2aa2bd7cb9a8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:58.496166 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-669ec755-adcd-40c7-9e04-2aa2bd7cb9a8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:58.503988 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-669ec755-adcd-40c7-9e04-2aa2bd7cb9a8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1444 microversion: 2.1 time: 0.152542 May 25 15:05:58.504555 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 431/872] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:58 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:58.520972 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-051c218f-1288-4995-b6eb-94ad906235e8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:58.521572 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-051c218f-1288-4995-b6eb-94ad906235e8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:58.523978 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:58.529242 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-051c218f-1288-4995-b6eb-94ad906235e8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:58.529686 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-051c218f-1288-4995-b6eb-94ad906235e8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:58.530475 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-051c218f-1288-4995-b6eb-94ad906235e8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:58.530909 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-051c218f-1288-4995-b6eb-94ad906235e8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:58.665662 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-051c218f-1288-4995-b6eb-94ad906235e8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:58.673187 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-051c218f-1288-4995-b6eb-94ad906235e8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1444 microversion: 2.1 time: 0.156651 May 25 15:05:58.674294 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 442/873] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:05:58 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:06:00.455799 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-110cf25f-a16c-4202-bc19-03fbe4235762 req-79da1e40-552b-4a4d-80f5-daf296d836dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3433ac-9290-4294-83ad-1fa030982ca5", "tag": "d91fb4f2-8eda-4755-a625-3d06bee0b78d"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:06:00.468041 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-110cf25f-a16c-4202-bc19-03fbe4235762 req-79da1e40-552b-4a4d-80f5-daf296d836dc service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:00.468490 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-110cf25f-a16c-4202-bc19-03fbe4235762 req-79da1e40-552b-4a4d-80f5-daf296d836dc service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:00.488724 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-110cf25f-a16c-4202-bc19-03fbe4235762 req-79da1e40-552b-4a4d-80f5-daf296d836dc service nova] Creating event network-changed:d91fb4f2-8eda-4755-a625-3d06bee0b78d for instance dc3433ac-9290-4294-83ad-1fa030982ca5 on hv-cinder-80382 May 25 15:06:00.495609 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-110cf25f-a16c-4202-bc19-03fbe4235762 req-79da1e40-552b-4a4d-80f5-daf296d836dc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046209 May 25 15:06:00.500322 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 432/874] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:06:01.647720 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a14f9be9-0346-441d-8b44-4de15b6d187c tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:01.648413 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a14f9be9-0346-441d-8b44-4de15b6d187c tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:01.655523 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a14f9be9-0346-441d-8b44-4de15b6d187c tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:01.655973 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a14f9be9-0346-441d-8b44-4de15b6d187c tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:01.656755 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a14f9be9-0346-441d-8b44-4de15b6d187c tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:01.657197 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a14f9be9-0346-441d-8b44-4de15b6d187c tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:01.791167 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a14f9be9-0346-441d-8b44-4de15b6d187c tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:01.799888 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a14f9be9-0346-441d-8b44-4de15b6d187c tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1594 microversion: 2.1 time: 0.155982 May 25 15:06:01.800467 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 443/875] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:06:01 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1594 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:03.866211 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-e59c8bc8-063f-475e-95cd-eeb6584534f6 req-fad586f5-fe34-46c5-9783-e5af9a29b652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aef5cf9-818a-4b1b-8305-258790e3845d", "tag": "14bd1814-6415-4936-8dc1-ab3f7060d8b1"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:06:03.875715 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:03.891490 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-e59c8bc8-063f-475e-95cd-eeb6584534f6 req-fad586f5-fe34-46c5-9783-e5af9a29b652 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:03.892892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-e59c8bc8-063f-475e-95cd-eeb6584534f6 req-fad586f5-fe34-46c5-9783-e5af9a29b652 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:03.911615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-e59c8bc8-063f-475e-95cd-eeb6584534f6 req-fad586f5-fe34-46c5-9783-e5af9a29b652 service nova] Creating event network-changed:14bd1814-6415-4936-8dc1-ab3f7060d8b1 for instance 5aef5cf9-818a-4b1b-8305-258790e3845d on hv-cinder-80382 May 25 15:06:03.934441 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-e59c8bc8-063f-475e-95cd-eeb6584534f6 req-fad586f5-fe34-46c5-9783-e5af9a29b652 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071129 May 25 15:06:03.951680 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 433/876] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:06:05.098182 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d888eb2f-e6fc-462b-acba-48b66093232f tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-848098611"}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:06:05.098823 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d888eb2f-e6fc-462b-acba-48b66093232f tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:05.112367 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d888eb2f-e6fc-462b-acba-48b66093232f tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:05.113324 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d888eb2f-e6fc-462b-acba-48b66093232f tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:05.115228 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d888eb2f-e6fc-462b-acba-48b66093232f tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:05.116412 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d888eb2f-e6fc-462b-acba-48b66093232f tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:05.349043 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.network.security_group_api [None req-d888eb2f-e6fc-462b-acba-48b66093232f tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Adding security group 6de920ad-333d-4f10-8a18-a2e9860b1a0e to port 14bd1814-6415-4936-8dc1-ab3f7060d8b1 May 25 15:06:05.770664 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d888eb2f-e6fc-462b-acba-48b66093232f tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "POST /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/action" status: 202 len: 0 microversion: 2.1 time: 0.676977 May 25 15:06:05.772501 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 444/877] 10.222.0.78 () {60 vars in 1277 bytes} [Wed May 25 15:06:05 2022] POST /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/action => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:06:05.782763 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0127a5e0-39e9-4c06-b82c-da2c7402ef42 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:05.784001 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0127a5e0-39e9-4c06-b82c-da2c7402ef42 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:05.790829 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0127a5e0-39e9-4c06-b82c-da2c7402ef42 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:05.791294 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0127a5e0-39e9-4c06-b82c-da2c7402ef42 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:05.792092 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0127a5e0-39e9-4c06-b82c-da2c7402ef42 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:05.792538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0127a5e0-39e9-4c06-b82c-da2c7402ef42 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:05.957570 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-5264b8f6-7491-482e-b68e-1cc79b5956fb req-be3eb7a1-3bc7-4602-8b03-2e6ee74d3a32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aef5cf9-818a-4b1b-8305-258790e3845d", "tag": "14bd1814-6415-4936-8dc1-ab3f7060d8b1"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:06:05.965976 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-5264b8f6-7491-482e-b68e-1cc79b5956fb req-be3eb7a1-3bc7-4602-8b03-2e6ee74d3a32 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:05.966452 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-5264b8f6-7491-482e-b68e-1cc79b5956fb req-be3eb7a1-3bc7-4602-8b03-2e6ee74d3a32 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:05.983327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-5264b8f6-7491-482e-b68e-1cc79b5956fb req-be3eb7a1-3bc7-4602-8b03-2e6ee74d3a32 service nova] Creating event network-changed:14bd1814-6415-4936-8dc1-ab3f7060d8b1 for instance 5aef5cf9-818a-4b1b-8305-258790e3845d on hv-cinder-80382 May 25 15:06:05.990774 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-5264b8f6-7491-482e-b68e-1cc79b5956fb req-be3eb7a1-3bc7-4602-8b03-2e6ee74d3a32 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037334 May 25 15:06:05.992124 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 445/878] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:06:06.056503 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-0127a5e0-39e9-4c06-b82c-da2c7402ef42 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:06.059176 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:06.068533 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0127a5e0-39e9-4c06-b82c-da2c7402ef42 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1759 microversion: 2.1 time: 0.291095 May 25 15:06:06.069384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 434/879] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:06:05 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1759 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:34.500699 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=7 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:34.501544 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=91 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:34.506514 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2eaa3a12-85fa-45b4-a63f-0dcdee3df359 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:34.507102 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2eaa3a12-85fa-45b4-a63f-0dcdee3df359 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:34.514457 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2eaa3a12-85fa-45b4-a63f-0dcdee3df359 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:34.514912 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2eaa3a12-85fa-45b4-a63f-0dcdee3df359 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:34.515680 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2eaa3a12-85fa-45b4-a63f-0dcdee3df359 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:34.516119 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2eaa3a12-85fa-45b4-a63f-0dcdee3df359 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:34.544082 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2eaa3a12-85fa-45b4-a63f-0dcdee3df359 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/os-volume_attachments/1706b179-616e-4849-9797-4941e952855b" status: 200 len: 194 microversion: 2.20 time: 0.044955 May 25 15:06:34.544651 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 446/880] 10.222.0.78 () {60 vars in 1453 bytes} [Wed May 25 15:06:34 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/os-volume_attachments/1706b179-616e-4849-9797-4941e952855b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:06:34.610155 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d58d75b4-0684-4500-a392-8c01ce98d397 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:34.610754 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d58d75b4-0684-4500-a392-8c01ce98d397 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:34.612931 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=47 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:34.620247 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d58d75b4-0684-4500-a392-8c01ce98d397 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:34.620687 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d58d75b4-0684-4500-a392-8c01ce98d397 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:34.621453 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d58d75b4-0684-4500-a392-8c01ce98d397 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:34.621888 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d58d75b4-0684-4500-a392-8c01ce98d397 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:34.704478 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-d58d75b4-0684-4500-a392-8c01ce98d397 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lazy-loading 'services' on Instance uuid 879adce9-e352-4e39-b80b-dcaee814c084 {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:06:34.775493 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d58d75b4-0684-4500-a392-8c01ce98d397 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "DELETE /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/os-volume_attachments/1706b179-616e-4849-9797-4941e952855b" status: 202 len: 0 microversion: 2.20 time: 0.169244 May 25 15:06:34.776504 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 435/881] 10.222.0.78 () {60 vars in 1456 bytes} [Wed May 25 15:06:34 2022] DELETE /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/os-volume_attachments/1706b179-616e-4849-9797-4941e952855b => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 15:06:34.784859 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-44d34b26-fab0-4acc-a2df-437d6e3b2a30 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:34.785819 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-44d34b26-fab0-4acc-a2df-437d6e3b2a30 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:34.792120 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-44d34b26-fab0-4acc-a2df-437d6e3b2a30 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:34.792655 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-44d34b26-fab0-4acc-a2df-437d6e3b2a30 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:34.793514 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-44d34b26-fab0-4acc-a2df-437d6e3b2a30 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:34.793957 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-44d34b26-fab0-4acc-a2df-437d6e3b2a30 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:34.824278 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-44d34b26-fab0-4acc-a2df-437d6e3b2a30 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043263 May 25 15:06:34.825030 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 447/882] 10.222.0.78 () {60 vars in 1342 bytes} [Wed May 25 15:06:34 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:06:35.837536 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-9655b11c-dbc4-41b1-bae1-fa961d226bd7 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:35.838646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-9655b11c-dbc4-41b1-bae1-fa961d226bd7 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:35.845501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9655b11c-dbc4-41b1-bae1-fa961d226bd7 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:35.845952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9655b11c-dbc4-41b1-bae1-fa961d226bd7 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:35.846749 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9655b11c-dbc4-41b1-bae1-fa961d226bd7 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:35.847185 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9655b11c-dbc4-41b1-bae1-fa961d226bd7 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:35.877084 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-9655b11c-dbc4-41b1-bae1-fa961d226bd7 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044506 May 25 15:06:35.877656 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 436/883] 10.222.0.78 () {60 vars in 1342 bytes} [Wed May 25 15:06:35 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:06:36.889558 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3f685d0a-45f6-419d-98c7-3e873a299554 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:36.890509 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-3f685d0a-45f6-419d-98c7-3e873a299554 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:36.897009 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3f685d0a-45f6-419d-98c7-3e873a299554 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:36.897486 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3f685d0a-45f6-419d-98c7-3e873a299554 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:36.898284 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3f685d0a-45f6-419d-98c7-3e873a299554 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:36.899018 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3f685d0a-45f6-419d-98c7-3e873a299554 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:36.928722 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3f685d0a-45f6-419d-98c7-3e873a299554 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043373 May 25 15:06:36.929272 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 448/884] 10.222.0.78 () {60 vars in 1342 bytes} [Wed May 25 15:06:36 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:36.995574 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-301f842e-cebe-4330-b229-9a1636b43a35 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:36.996295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-301f842e-cebe-4330-b229-9a1636b43a35 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:37.006965 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-301f842e-cebe-4330-b229-9a1636b43a35 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:37.007411 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-301f842e-cebe-4330-b229-9a1636b43a35 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:37.008172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-301f842e-cebe-4330-b229-9a1636b43a35 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:37.008608 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-301f842e-cebe-4330-b229-9a1636b43a35 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:37.043836 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-301f842e-cebe-4330-b229-9a1636b43a35 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Going to try to terminate instance {{(pid=124524) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:06:37.134760 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-301f842e-cebe-4330-b229-9a1636b43a35 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "DELETE /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 204 len: 0 microversion: 2.20 time: 0.145226 May 25 15:06:37.135452 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 437/885] 10.222.0.78 () {60 vars in 1279 bytes} [Wed May 25 15:06:36 2022] DELETE /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 15:06:37.146082 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-cb395f56-919d-4b4b-b7d9-7ec5d9ce604a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:37.146857 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-cb395f56-919d-4b4b-b7d9-7ec5d9ce604a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:37.153037 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cb395f56-919d-4b4b-b7d9-7ec5d9ce604a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:37.153488 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cb395f56-919d-4b4b-b7d9-7ec5d9ce604a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:37.154286 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cb395f56-919d-4b4b-b7d9-7ec5d9ce604a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:37.154722 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cb395f56-919d-4b4b-b7d9-7ec5d9ce604a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:37.284713 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-cb395f56-919d-4b4b-b7d9-7ec5d9ce604a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:37.293470 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-cb395f56-919d-4b4b-b7d9-7ec5d9ce604a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:37.294966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-cb395f56-919d-4b4b-b7d9-7ec5d9ce604a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:37.296132 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-cb395f56-919d-4b4b-b7d9-7ec5d9ce604a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1724 microversion: 2.20 time: 0.155576 May 25 15:06:37.296723 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 449/886] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:06:37 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:06:38.314508 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6961b689-bc2b-4438-8605-5b63d2a64b6d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:38.315198 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6961b689-bc2b-4438-8605-5b63d2a64b6d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:38.321659 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6961b689-bc2b-4438-8605-5b63d2a64b6d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:38.322132 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6961b689-bc2b-4438-8605-5b63d2a64b6d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:38.322884 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6961b689-bc2b-4438-8605-5b63d2a64b6d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:38.323312 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6961b689-bc2b-4438-8605-5b63d2a64b6d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:38.461915 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6961b689-bc2b-4438-8605-5b63d2a64b6d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:38.469850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6961b689-bc2b-4438-8605-5b63d2a64b6d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:38.471394 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6961b689-bc2b-4438-8605-5b63d2a64b6d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:38.472878 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6961b689-bc2b-4438-8605-5b63d2a64b6d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1724 microversion: 2.20 time: 0.162342 May 25 15:06:38.473128 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 438/887] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:06:38 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:06:39.491996 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f91267f6-b3cd-452e-be9f-995fd67eaea3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:39.492618 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f91267f6-b3cd-452e-be9f-995fd67eaea3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:39.499353 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f91267f6-b3cd-452e-be9f-995fd67eaea3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:39.499806 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f91267f6-b3cd-452e-be9f-995fd67eaea3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:39.500604 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f91267f6-b3cd-452e-be9f-995fd67eaea3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:39.501025 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f91267f6-b3cd-452e-be9f-995fd67eaea3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:39.631049 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f91267f6-b3cd-452e-be9f-995fd67eaea3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:39.639937 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f91267f6-b3cd-452e-be9f-995fd67eaea3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:39.641425 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f91267f6-b3cd-452e-be9f-995fd67eaea3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:39.642619 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f91267f6-b3cd-452e-be9f-995fd67eaea3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1724 microversion: 2.20 time: 0.155161 May 25 15:06:39.643162 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 450/888] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:06:39 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:06:40.661029 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-70342c03-2d62-437d-8d38-f752b5fddbbe tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:40.661659 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-70342c03-2d62-437d-8d38-f752b5fddbbe tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:40.669161 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-70342c03-2d62-437d-8d38-f752b5fddbbe tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:40.669602 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-70342c03-2d62-437d-8d38-f752b5fddbbe tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:40.670403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-70342c03-2d62-437d-8d38-f752b5fddbbe tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:40.671119 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-70342c03-2d62-437d-8d38-f752b5fddbbe tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:40.737328 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-70342c03-2d62-437d-8d38-f752b5fddbbe tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:40.746979 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-70342c03-2d62-437d-8d38-f752b5fddbbe tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:40.748504 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-70342c03-2d62-437d-8d38-f752b5fddbbe tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:40.749694 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-70342c03-2d62-437d-8d38-f752b5fddbbe tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 200 len: 1657 microversion: 2.20 time: 0.092871 May 25 15:06:40.750371 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 439/889] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:06:40 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 1657 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:06:41.050237 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-d811b5a5-0347-4421-95f4-48219a646064 req-9347848b-6f44-4094-8a93-056d1c2e9dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879adce9-e352-4e39-b80b-dcaee814c084", "name": "network-vif-deleted", "tag": "1f402e27-3709-41db-8b59-49501ea83eb5"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:06:41.058797 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-d811b5a5-0347-4421-95f4-48219a646064 req-9347848b-6f44-4094-8a93-056d1c2e9dc4 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:41.059247 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-d811b5a5-0347-4421-95f4-48219a646064 req-9347848b-6f44-4094-8a93-056d1c2e9dc4 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:41.072280 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-d811b5a5-0347-4421-95f4-48219a646064 req-9347848b-6f44-4094-8a93-056d1c2e9dc4 service nova] Creating event network-vif-deleted:1f402e27-3709-41db-8b59-49501ea83eb5 for instance 879adce9-e352-4e39-b80b-dcaee814c084 on hv-cinder-80382 May 25 15:06:41.078283 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-d811b5a5-0347-4421-95f4-48219a646064 req-9347848b-6f44-4094-8a93-056d1c2e9dc4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090421 May 25 15:06:41.079509 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 451/890] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:06:41.380233 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d632a5eb-b226-4ec0-9dc8-6a87529fad88 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:06:41.381834 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d632a5eb-b226-4ec0-9dc8-6a87529fad88 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:41.388214 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d632a5eb-b226-4ec0-9dc8-6a87529fad88 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:41.388662 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d632a5eb-b226-4ec0-9dc8-6a87529fad88 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:41.389433 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d632a5eb-b226-4ec0-9dc8-6a87529fad88 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:41.389949 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d632a5eb-b226-4ec0-9dc8-6a87529fad88 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:41.468640 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d632a5eb-b226-4ec0-9dc8-6a87529fad88 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "POST /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/action" status: 202 len: 0 microversion: 2.1 time: 0.092248 May 25 15:06:41.469273 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 440/891] 10.222.0.78 () {60 vars in 1277 bytes} [Wed May 25 15:06:41 2022] POST /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:06:41.478610 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-095369b2-10f5-4c17-a5b4-66eef6023528 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:41.479330 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-095369b2-10f5-4c17-a5b4-66eef6023528 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:41.485619 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-095369b2-10f5-4c17-a5b4-66eef6023528 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:41.486088 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-095369b2-10f5-4c17-a5b4-66eef6023528 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:41.486851 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-095369b2-10f5-4c17-a5b4-66eef6023528 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:41.487279 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-095369b2-10f5-4c17-a5b4-66eef6023528 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:41.656525 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-095369b2-10f5-4c17-a5b4-66eef6023528 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:41.665723 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-095369b2-10f5-4c17-a5b4-66eef6023528 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1751 microversion: 2.1 time: 0.191856 May 25 15:06:41.670710 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 452/892] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:06:41 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1751 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:41.769512 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a9b51f65-0be8-406d-96e2-d08359579951 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:41.770253 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-a9b51f65-0be8-406d-96e2-d08359579951 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:41.777172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a9b51f65-0be8-406d-96e2-d08359579951 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:41.777633 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a9b51f65-0be8-406d-96e2-d08359579951 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:41.778440 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a9b51f65-0be8-406d-96e2-d08359579951 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:41.778873 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a9b51f65-0be8-406d-96e2-d08359579951 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:41.793496 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-a9b51f65-0be8-406d-96e2-d08359579951 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] HTTP exception thrown: Instance 879adce9-e352-4e39-b80b-dcaee814c084 could not be found. May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a9b51f65-0be8-406d-96e2-d08359579951 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Request method failure captured: May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 HTTP/1.1 May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkUgp6m_kwxCAe9V3iT-kXjjxNWQpfy-pG3HImpEKDHtpajyzB-pjjCwd96lr6_nS1E3kSuWdbSoggTqUCK42Vc5UR6qQS1eRCgEYddjF1t0A_ITvmAA47Kdc7H9xzjYum6RmrKzNdAZxGIWBgoNytrHUrayNghy7e_wsMKoQbuTFpo May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Openstack-Nova-Api-Version: 2.20 May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 2b586a13e82f4177a7180f81acf675fd May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1960233767 May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:06:41.795261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:06:41.797003 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2b586a13e82f4177a7180f81acf675fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2b586a13e82f4177a7180f81acf675fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b586a13e82f4177a7180f81acf675fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b586a13e82f4177a7180f81acf675fd"}]}] May 25 15:06:41.797003 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1960233767 May 25 15:06:41.797003 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 2b586a13e82f4177a7180f81acf675fd May 25 15:06:41.797003 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1960233767 May 25 15:06:41.797003 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-AttachVolumeShelveTestJSON-1960233767-project May 25 15:06:41.797003 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:06:41.797003 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:06:41.797003 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: 34b1591b0eb944ed98c42d35a03c1ff9 May 25 15:06:41.797003 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1960233767-project May 25 15:06:41.797003 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:06:41.797003 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance 879adce9-e352-4e39-b80b-dcaee814c084 could not be found. May 25 15:06:41.797003 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': '879adce9-e352-4e39-b80b-dcaee814c084'} May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879adce9-e352-4e39-b80b-dcaee814c084 could not be found. May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:06:41.797991 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:06:41.799501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:06:41.799501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:06:41.799501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:06:41.799501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:06:41.799501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:06:41.799501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:06:41.799501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:06:41.799501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879adce9-e352-4e39-b80b-dcaee814c084 could not be found. May 25 15:06:41.799501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:06:41.799501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:41.799501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:06:41.799501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:41.799501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:41.799501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:41.799501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:06:41.799501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:06:41.799501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879adce9-e352-4e39-b80b-dcaee814c084 could not be found. May 25 15:06:41.799501 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:06:41.801682 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a9b51f65-0be8-406d-96e2-d08359579951 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Returning 404 to user: Instance 879adce9-e352-4e39-b80b-dcaee814c084 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:06:41.802772 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-a9b51f65-0be8-406d-96e2-d08359579951 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 404 len: 111 microversion: 2.20 time: 0.038060 May 25 15:06:41.804087 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 441/893] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:06:41 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 15:06:41.812995 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-72cfa2eb-9f65-4aa2-be31-06d1399d7ac5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '.version_select at 0x7fb1e4142040>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:41.834385 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-72cfa2eb-9f65-4aa2-be31-06d1399d7ac5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1262597987" status: 204 len: 0 microversion: 2.20 time: 0.025136 May 25 15:06:41.835336 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 453/894] 10.222.0.78 () {60 vars in 1261 bytes} [Wed May 25 15:06:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1262597987 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 15:06:42.506628 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d72b6ab2-4718-4073-9f0a-d7d98105a8f0 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Action: 'create', calling method: .version_select at 0x7fb1e0211040>, body: {"keypair": {"name": "tempest-keypair-1572626535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJG6vda6+0+53gNJpw83ze8ffWRHlqcGeqstt9VKemYQqa8Jgoy3DDvrJG9ZkS2oHDlt/pWdeNON+4ZrkKebEg4g1gwE1HGaPkV2pUglCQTmYXq2EGX29QzqjYglWTLNMg=="}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:06:42.520640 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-d72b6ab2-4718-4073-9f0a-d7d98105a8f0 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Getting quotas for project 2b586a13e82f4177a7180f81acf675fd. Resources: {'key_pairs'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:06:42.525219 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-d72b6ab2-4718-4073-9f0a-d7d98105a8f0 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Getting quotas for user 34b1591b0eb944ed98c42d35a03c1ff9 and project 2b586a13e82f4177a7180f81acf675fd. Resources: {'key_pairs'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:06:42.549304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d72b6ab2-4718-4073-9f0a-d7d98105a8f0 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047143 May 25 15:06:42.549903 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 442/895] 10.222.0.78 () {62 vars in 1199 bytes} [Wed May 25 15:06:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 25 15:06:42.685276 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-fcd6594d-663d-4651-9532-28d3f2a20bf0 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:42.686037 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-fcd6594d-663d-4651-9532-28d3f2a20bf0 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:42.695041 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fcd6594d-663d-4651-9532-28d3f2a20bf0 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:42.695617 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fcd6594d-663d-4651-9532-28d3f2a20bf0 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:42.696462 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fcd6594d-663d-4651-9532-28d3f2a20bf0 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:42.697031 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fcd6594d-663d-4651-9532-28d3f2a20bf0 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:42.902130 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-fcd6594d-663d-4651-9532-28d3f2a20bf0 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:42.911140 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-fcd6594d-663d-4651-9532-28d3f2a20bf0 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1756 microversion: 2.1 time: 0.230051 May 25 15:06:42.911900 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 454/896] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:06:42 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1756 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:43.929869 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-e6c80185-558b-4a09-8c6b-bbca14d49f6b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:43.931207 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-e6c80185-558b-4a09-8c6b-bbca14d49f6b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:43.938280 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e6c80185-558b-4a09-8c6b-bbca14d49f6b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:43.938799 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e6c80185-558b-4a09-8c6b-bbca14d49f6b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:43.939632 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e6c80185-558b-4a09-8c6b-bbca14d49f6b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:43.940150 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e6c80185-558b-4a09-8c6b-bbca14d49f6b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:43.958144 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b89ac914-72ba-4e1c-891d-b054a2c89556 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-32098197", "imageRef": "fbec7c78-0103-4632-9a21-d8e8056f2ce0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6028651b-e908-45f7-9bba-a9ff244363d6"}], "security_groups": [{"name": "tempest-securitygroup--2069156598"}], "key_name": "tempest-keypair-1572626535", "user_data": "}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:06:44.065570 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.network.neutron [None req-b89ac914-72ba-4e1c-891d-b054a2c89556 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] validate_networks() for [('6028651b-e908-45f7-9bba-a9ff244363d6', None, None, None, None, None)] {{(pid=124523) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:06:44.090462 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-e6c80185-558b-4a09-8c6b-bbca14d49f6b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:44.099423 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-e6c80185-558b-4a09-8c6b-bbca14d49f6b tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1756 microversion: 2.1 time: 0.174495 May 25 15:06:44.100569 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 443/897] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:06:43 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:44.445018 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-b89ac914-72ba-4e1c-891d-b054a2c89556 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Flavor limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:06:44.445433 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-b89ac914-72ba-4e1c-891d-b054a2c89556 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Image limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:06:44.445911 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-b89ac914-72ba-4e1c-891d-b054a2c89556 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Flavor pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:06:44.446348 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-b89ac914-72ba-4e1c-891d-b054a2c89556 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Image pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:06:44.446766 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-b89ac914-72ba-4e1c-891d-b054a2c89556 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:06:44.455679 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b89ac914-72ba-4e1c-891d-b054a2c89556 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:44.456125 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b89ac914-72ba-4e1c-891d-b054a2c89556 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:44.456915 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b89ac914-72ba-4e1c-891d-b054a2c89556 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:44.457348 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b89ac914-72ba-4e1c-891d-b054a2c89556 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:44.474317 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-b89ac914-72ba-4e1c-891d-b054a2c89556 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Getting quotas for project 2b586a13e82f4177a7180f81acf675fd. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:06:44.479150 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-b89ac914-72ba-4e1c-891d-b054a2c89556 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Getting quotas for user 34b1591b0eb944ed98c42d35a03c1ff9 and project 2b586a13e82f4177a7180f81acf675fd. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:06:44.490145 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-b89ac914-72ba-4e1c-891d-b054a2c89556 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Going to run 1 instances... {{(pid=124523) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:06:44.492944 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-b89ac914-72ba-4e1c-891d-b054a2c89556 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbec7c78-0103-4632-9a21-d8e8056f2ce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:06:44.540171 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-b89ac914-72ba-4e1c-891d-b054a2c89556 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.586518 May 25 15:06:44.541047 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 455/898] 10.222.0.78 () {62 vars in 1187 bytes} [Wed May 25 15:06:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 25 15:06:44.550693 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d3c66eb2-6f29-4b2b-b475-a434063893b8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:44.551305 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d3c66eb2-6f29-4b2b-b475-a434063893b8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:44.603528 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d3c66eb2-6f29-4b2b-b475-a434063893b8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:44.611817 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d3c66eb2-6f29-4b2b-b475-a434063893b8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:44.612967 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d3c66eb2-6f29-4b2b-b475-a434063893b8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:44.614519 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d3c66eb2-6f29-4b2b-b475-a434063893b8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1280 microversion: 2.20 time: 0.067300 May 25 15:06:44.614994 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 444/899] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:06:44 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:06:45.117941 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-72365e76-a718-4afb-b593-555e276fceef tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:45.118570 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-72365e76-a718-4afb-b593-555e276fceef tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:45.125514 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-72365e76-a718-4afb-b593-555e276fceef tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:45.125969 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-72365e76-a718-4afb-b593-555e276fceef tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:45.126802 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-72365e76-a718-4afb-b593-555e276fceef tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:45.127361 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-72365e76-a718-4afb-b593-555e276fceef tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:45.274197 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-72365e76-a718-4afb-b593-555e276fceef tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:45.282708 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-72365e76-a718-4afb-b593-555e276fceef tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1756 microversion: 2.1 time: 0.169686 May 25 15:06:45.283493 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 456/900] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:06:45 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:45.631779 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-aed8c6ec-cc9d-4c8e-81ce-475e60e736d1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:45.632415 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-aed8c6ec-cc9d-4c8e-81ce-475e60e736d1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:45.639409 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aed8c6ec-cc9d-4c8e-81ce-475e60e736d1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:45.639861 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aed8c6ec-cc9d-4c8e-81ce-475e60e736d1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:45.640628 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aed8c6ec-cc9d-4c8e-81ce-475e60e736d1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:45.641065 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aed8c6ec-cc9d-4c8e-81ce-475e60e736d1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:45.708100 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-aed8c6ec-cc9d-4c8e-81ce-475e60e736d1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:45.716719 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-aed8c6ec-cc9d-4c8e-81ce-475e60e736d1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:45.718263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-aed8c6ec-cc9d-4c8e-81ce-475e60e736d1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:45.719365 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-aed8c6ec-cc9d-4c8e-81ce-475e60e736d1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1332 microversion: 2.20 time: 0.091562 May 25 15:06:45.719942 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 445/901] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:06:45 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1332 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:06:46.299883 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-641e7a54-273b-49fb-b3bc-911dcef36e1a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:46.300489 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-641e7a54-273b-49fb-b3bc-911dcef36e1a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:46.307239 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-641e7a54-273b-49fb-b3bc-911dcef36e1a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:46.307682 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-641e7a54-273b-49fb-b3bc-911dcef36e1a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:46.308442 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-641e7a54-273b-49fb-b3bc-911dcef36e1a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:46.308940 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-641e7a54-273b-49fb-b3bc-911dcef36e1a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:46.554357 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-641e7a54-273b-49fb-b3bc-911dcef36e1a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:46.562706 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-641e7a54-273b-49fb-b3bc-911dcef36e1a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1756 microversion: 2.1 time: 0.266587 May 25 15:06:46.563294 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 457/902] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:06:46 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1756 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:06:46.737371 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-9832c867-a0b2-4820-8c39-2f42a0bd1733 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:46.737999 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-9832c867-a0b2-4820-8c39-2f42a0bd1733 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:46.744212 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9832c867-a0b2-4820-8c39-2f42a0bd1733 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:46.744663 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9832c867-a0b2-4820-8c39-2f42a0bd1733 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:46.745504 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9832c867-a0b2-4820-8c39-2f42a0bd1733 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:46.745942 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9832c867-a0b2-4820-8c39-2f42a0bd1733 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:46.808535 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-9832c867-a0b2-4820-8c39-2f42a0bd1733 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:46.816641 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-9832c867-a0b2-4820-8c39-2f42a0bd1733 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:46.818206 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-9832c867-a0b2-4820-8c39-2f42a0bd1733 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:46.819938 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-9832c867-a0b2-4820-8c39-2f42a0bd1733 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1338 microversion: 2.20 time: 0.087120 May 25 15:06:46.820493 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 446/903] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:06:46 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1338 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:06:47.582142 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8db2d968-8d41-4cf1-b71b-5b9db92d68d1 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:47.583240 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8db2d968-8d41-4cf1-b71b-5b9db92d68d1 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:47.591295 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8db2d968-8d41-4cf1-b71b-5b9db92d68d1 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:47.591840 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8db2d968-8d41-4cf1-b71b-5b9db92d68d1 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:47.592706 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8db2d968-8d41-4cf1-b71b-5b9db92d68d1 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:47.593251 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8db2d968-8d41-4cf1-b71b-5b9db92d68d1 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:47.686843 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-26eec420-9291-43a1-a166-16df1d6b65ae req-12b143a5-1380-48c5-8b03-a9edebe845c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4202b1b8-016d-4d26-ad4a-a2d3f6b58c65", "tag": "e6550da8-2d3f-49e5-ba79-3b3fb3daaf6a"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:06:47.697273 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-26eec420-9291-43a1-a166-16df1d6b65ae req-12b143a5-1380-48c5-8b03-a9edebe845c4 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:47.698534 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-26eec420-9291-43a1-a166-16df1d6b65ae req-12b143a5-1380-48c5-8b03-a9edebe845c4 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:47.719198 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-26eec420-9291-43a1-a166-16df1d6b65ae req-12b143a5-1380-48c5-8b03-a9edebe845c4 service nova] Creating event network-changed:e6550da8-2d3f-49e5-ba79-3b3fb3daaf6a for instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 on hv-cinder-80382 May 25 15:06:47.732844 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-26eec420-9291-43a1-a166-16df1d6b65ae req-12b143a5-1380-48c5-8b03-a9edebe845c4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049399 May 25 15:06:47.733589 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 447/904] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:06:47.791564 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8db2d968-8d41-4cf1-b71b-5b9db92d68d1 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:47.804059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8db2d968-8d41-4cf1-b71b-5b9db92d68d1 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1756 microversion: 2.1 time: 0.224786 May 25 15:06:47.804992 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 458/905] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:06:47 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1756 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:47.838996 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a8055714-957d-4a63-b562-89eb25c35c23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:47.839688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-a8055714-957d-4a63-b562-89eb25c35c23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:47.846338 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a8055714-957d-4a63-b562-89eb25c35c23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:47.846792 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a8055714-957d-4a63-b562-89eb25c35c23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:47.847562 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a8055714-957d-4a63-b562-89eb25c35c23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:47.848001 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a8055714-957d-4a63-b562-89eb25c35c23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:47.982321 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-a8055714-957d-4a63-b562-89eb25c35c23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:47.990313 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-a8055714-957d-4a63-b562-89eb25c35c23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:47.992320 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-a8055714-957d-4a63-b562-89eb25c35c23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:47.993437 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-a8055714-957d-4a63-b562-89eb25c35c23 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1406 microversion: 2.20 time: 0.159268 May 25 15:06:47.993992 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 448/906] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:06:47 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:06:48.821747 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-18691186-a88d-43db-a165-bb7b1b2b075e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:48.822403 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-18691186-a88d-43db-a165-bb7b1b2b075e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:48.828972 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-18691186-a88d-43db-a165-bb7b1b2b075e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:48.829425 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-18691186-a88d-43db-a165-bb7b1b2b075e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:48.830233 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-18691186-a88d-43db-a165-bb7b1b2b075e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:48.830673 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-18691186-a88d-43db-a165-bb7b1b2b075e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:48.971806 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-18691186-a88d-43db-a165-bb7b1b2b075e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:48.980447 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-18691186-a88d-43db-a165-bb7b1b2b075e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1756 microversion: 2.1 time: 0.162586 May 25 15:06:48.981000 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 459/907] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:06:48 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:49.013242 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-70c01aaa-8f51-461f-b8c3-394adf5255ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:49.013850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-70c01aaa-8f51-461f-b8c3-394adf5255ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:49.020544 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-70c01aaa-8f51-461f-b8c3-394adf5255ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:49.021000 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-70c01aaa-8f51-461f-b8c3-394adf5255ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:49.021828 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-70c01aaa-8f51-461f-b8c3-394adf5255ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:49.022301 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-70c01aaa-8f51-461f-b8c3-394adf5255ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:49.153574 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-70c01aaa-8f51-461f-b8c3-394adf5255ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:49.161664 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-70c01aaa-8f51-461f-b8c3-394adf5255ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:49.163716 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-70c01aaa-8f51-461f-b8c3-394adf5255ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:49.164825 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-70c01aaa-8f51-461f-b8c3-394adf5255ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1406 microversion: 2.20 time: 0.155685 May 25 15:06:49.165375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 449/908] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:06:49 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:06:49.997647 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-9ba8173a-31fa-4119-b4bb-4872da991a59 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:49.998281 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-9ba8173a-31fa-4119-b4bb-4872da991a59 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:50.004786 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9ba8173a-31fa-4119-b4bb-4872da991a59 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:50.005236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9ba8173a-31fa-4119-b4bb-4872da991a59 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:50.006056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9ba8173a-31fa-4119-b4bb-4872da991a59 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:50.006503 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9ba8173a-31fa-4119-b4bb-4872da991a59 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:50.183206 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b438c4a5-8977-48bd-bfec-9b3f4dda72ab tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:50.183851 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b438c4a5-8977-48bd-bfec-9b3f4dda72ab tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:50.190354 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b438c4a5-8977-48bd-bfec-9b3f4dda72ab tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:50.190804 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b438c4a5-8977-48bd-bfec-9b3f4dda72ab tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:50.191574 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b438c4a5-8977-48bd-bfec-9b3f4dda72ab tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:50.192006 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b438c4a5-8977-48bd-bfec-9b3f4dda72ab tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:50.227372 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-9ba8173a-31fa-4119-b4bb-4872da991a59 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:50.235510 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-9ba8173a-31fa-4119-b4bb-4872da991a59 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1756 microversion: 2.1 time: 0.241674 May 25 15:06:50.236095 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 460/909] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:06:49 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1756 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:50.335814 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b438c4a5-8977-48bd-bfec-9b3f4dda72ab tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:50.343827 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b438c4a5-8977-48bd-bfec-9b3f4dda72ab tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:50.345324 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b438c4a5-8977-48bd-bfec-9b3f4dda72ab tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:50.346451 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b438c4a5-8977-48bd-bfec-9b3f4dda72ab tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1406 microversion: 2.20 time: 0.167149 May 25 15:06:50.347010 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 450/910] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:06:50 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:06:51.252880 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a5316096-1766-4fa1-959e-636a66773cf3 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:51.253527 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a5316096-1766-4fa1-959e-636a66773cf3 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:51.260075 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a5316096-1766-4fa1-959e-636a66773cf3 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:51.260530 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a5316096-1766-4fa1-959e-636a66773cf3 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:51.261571 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a5316096-1766-4fa1-959e-636a66773cf3 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:51.262036 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a5316096-1766-4fa1-959e-636a66773cf3 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:51.364912 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-45a9732e-b814-486f-81b7-51f220a4c64a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:51.365813 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-45a9732e-b814-486f-81b7-51f220a4c64a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:51.371808 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-45a9732e-b814-486f-81b7-51f220a4c64a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:51.372266 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-45a9732e-b814-486f-81b7-51f220a4c64a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:51.373037 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-45a9732e-b814-486f-81b7-51f220a4c64a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:51.373472 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-45a9732e-b814-486f-81b7-51f220a4c64a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:51.389403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:51.410225 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a5316096-1766-4fa1-959e-636a66773cf3 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:51.419013 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a5316096-1766-4fa1-959e-636a66773cf3 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1756 microversion: 2.1 time: 0.169911 May 25 15:06:51.419899 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 461/911] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:06:51 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:51.502685 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-45a9732e-b814-486f-81b7-51f220a4c64a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:51.511540 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-45a9732e-b814-486f-81b7-51f220a4c64a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:51.512999 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-45a9732e-b814-486f-81b7-51f220a4c64a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:51.514139 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-45a9732e-b814-486f-81b7-51f220a4c64a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1406 microversion: 2.20 time: 0.153913 May 25 15:06:51.514692 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 451/912] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:06:51 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:06:52.436755 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-05d692cd-e65e-48f5-a638-1c540f2866e6 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:52.437366 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-05d692cd-e65e-48f5-a638-1c540f2866e6 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:52.443999 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-05d692cd-e65e-48f5-a638-1c540f2866e6 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:52.444447 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-05d692cd-e65e-48f5-a638-1c540f2866e6 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:52.445209 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-05d692cd-e65e-48f5-a638-1c540f2866e6 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:52.445645 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-05d692cd-e65e-48f5-a638-1c540f2866e6 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:52.532792 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-dd707e39-6100-4430-8b5b-848a4fa036ec tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:52.533402 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-dd707e39-6100-4430-8b5b-848a4fa036ec tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:52.540939 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dd707e39-6100-4430-8b5b-848a4fa036ec tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:52.541390 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dd707e39-6100-4430-8b5b-848a4fa036ec tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:52.542199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dd707e39-6100-4430-8b5b-848a4fa036ec tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:52.542635 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dd707e39-6100-4430-8b5b-848a4fa036ec tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:52.596081 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-05d692cd-e65e-48f5-a638-1c540f2866e6 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:52.604697 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-05d692cd-e65e-48f5-a638-1c540f2866e6 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1756 microversion: 2.1 time: 0.171796 May 25 15:06:52.605336 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 462/913] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:06:52 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:52.679727 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-dd707e39-6100-4430-8b5b-848a4fa036ec tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:52.687754 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-dd707e39-6100-4430-8b5b-848a4fa036ec tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:52.689266 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-dd707e39-6100-4430-8b5b-848a4fa036ec tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:52.690401 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-dd707e39-6100-4430-8b5b-848a4fa036ec tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1406 microversion: 2.20 time: 0.161538 May 25 15:06:52.690963 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 452/914] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:06:52 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:06:53.622535 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-7d3c8b76-a119-498d-90bc-30409c377d21 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:53.623164 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-7d3c8b76-a119-498d-90bc-30409c377d21 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:53.629627 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7d3c8b76-a119-498d-90bc-30409c377d21 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:53.630105 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7d3c8b76-a119-498d-90bc-30409c377d21 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:53.630882 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7d3c8b76-a119-498d-90bc-30409c377d21 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:53.631323 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-7d3c8b76-a119-498d-90bc-30409c377d21 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:53.708548 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-fbb846a0-0f48-4a6e-818d-9207d82713ac tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:53.711777 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-fbb846a0-0f48-4a6e-818d-9207d82713ac tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:53.720578 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fbb846a0-0f48-4a6e-818d-9207d82713ac tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:53.721029 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fbb846a0-0f48-4a6e-818d-9207d82713ac tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:53.722369 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fbb846a0-0f48-4a6e-818d-9207d82713ac tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:53.723073 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fbb846a0-0f48-4a6e-818d-9207d82713ac tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:53.797019 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-7d3c8b76-a119-498d-90bc-30409c377d21 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:53.807107 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-7d3c8b76-a119-498d-90bc-30409c377d21 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1756 microversion: 2.1 time: 0.188511 May 25 15:06:53.807819 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 463/915] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:06:53 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:53.815835 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-8bbf6e6b-27c1-48a0-a6dd-f861b5959661 req-75eb0fe9-6fe8-4292-93d1-5239f34b5fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4202b1b8-016d-4d26-ad4a-a2d3f6b58c65", "name": "network-vif-plugged", "status": "completed", "tag": "e6550da8-2d3f-49e5-ba79-3b3fb3daaf6a"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:06:53.825307 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-8bbf6e6b-27c1-48a0-a6dd-f861b5959661 req-75eb0fe9-6fe8-4292-93d1-5239f34b5fab service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:53.825754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-8bbf6e6b-27c1-48a0-a6dd-f861b5959661 req-75eb0fe9-6fe8-4292-93d1-5239f34b5fab service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:53.837929 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-8bbf6e6b-27c1-48a0-a6dd-f861b5959661 req-75eb0fe9-6fe8-4292-93d1-5239f34b5fab service nova] Creating event network-vif-plugged:e6550da8-2d3f-49e5-ba79-3b3fb3daaf6a for instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 on hv-cinder-80382 May 25 15:06:53.843004 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-8bbf6e6b-27c1-48a0-a6dd-f861b5959661 req-75eb0fe9-6fe8-4292-93d1-5239f34b5fab service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033900 May 25 15:06:53.843756 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 464/916] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:06:53.869916 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-fbb846a0-0f48-4a6e-818d-9207d82713ac tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:53.878223 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-fbb846a0-0f48-4a6e-818d-9207d82713ac tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:53.879737 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-fbb846a0-0f48-4a6e-818d-9207d82713ac tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:53.880852 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-fbb846a0-0f48-4a6e-818d-9207d82713ac tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1406 microversion: 2.20 time: 0.176826 May 25 15:06:53.881413 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 453/917] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:06:53 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:06:54.822254 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=2 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:54.823012 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=6 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:54.827464 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-348e427e-9fae-437e-aa60-f8366afd8689 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:54.828184 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-348e427e-9fae-437e-aa60-f8366afd8689 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:54.835257 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-348e427e-9fae-437e-aa60-f8366afd8689 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:54.835708 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-348e427e-9fae-437e-aa60-f8366afd8689 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:54.836491 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-348e427e-9fae-437e-aa60-f8366afd8689 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:54.836926 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-348e427e-9fae-437e-aa60-f8366afd8689 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:54.854551 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=100 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:54.899792 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-0ce6ebf7-4cd2-41d7-b941-b7f117e162ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:54.901304 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-0ce6ebf7-4cd2-41d7-b941-b7f117e162ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:54.903461 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=6 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:54.910027 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0ce6ebf7-4cd2-41d7-b941-b7f117e162ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:54.910465 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0ce6ebf7-4cd2-41d7-b941-b7f117e162ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:54.911298 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0ce6ebf7-4cd2-41d7-b941-b7f117e162ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:54.911735 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-0ce6ebf7-4cd2-41d7-b941-b7f117e162ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:54.989173 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-348e427e-9fae-437e-aa60-f8366afd8689 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:54.998396 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-348e427e-9fae-437e-aa60-f8366afd8689 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1756 microversion: 2.1 time: 0.177028 May 25 15:06:54.998978 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 465/918] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:06:54 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:06:55.047629 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-0ce6ebf7-4cd2-41d7-b941-b7f117e162ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:55.056103 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-0ce6ebf7-4cd2-41d7-b941-b7f117e162ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:55.057618 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-0ce6ebf7-4cd2-41d7-b941-b7f117e162ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:55.058756 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-0ce6ebf7-4cd2-41d7-b941-b7f117e162ee tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1406 microversion: 2.20 time: 0.163001 May 25 15:06:55.059319 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 454/919] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:06:54 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:06:56.015672 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-9f88e372-c8f6-4efb-8cc9-2620aabd1d1a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:56.016320 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-9f88e372-c8f6-4efb-8cc9-2620aabd1d1a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:56.023660 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9f88e372-c8f6-4efb-8cc9-2620aabd1d1a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:56.024132 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9f88e372-c8f6-4efb-8cc9-2620aabd1d1a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:56.024881 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9f88e372-c8f6-4efb-8cc9-2620aabd1d1a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:56.025322 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9f88e372-c8f6-4efb-8cc9-2620aabd1d1a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:56.076704 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-48c1eb33-a4e8-4dd5-8659-d8b7535582c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:56.077303 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-48c1eb33-a4e8-4dd5-8659-d8b7535582c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:56.083431 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-48c1eb33-a4e8-4dd5-8659-d8b7535582c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:56.083873 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-48c1eb33-a4e8-4dd5-8659-d8b7535582c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:56.084662 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-48c1eb33-a4e8-4dd5-8659-d8b7535582c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:56.086337 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-48c1eb33-a4e8-4dd5-8659-d8b7535582c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:56.173118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-9f88e372-c8f6-4efb-8cc9-2620aabd1d1a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:56.181811 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-9f88e372-c8f6-4efb-8cc9-2620aabd1d1a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1756 microversion: 2.1 time: 0.170006 May 25 15:06:56.182720 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 466/920] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:06:56 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:56.219543 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-48c1eb33-a4e8-4dd5-8659-d8b7535582c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:56.227621 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-48c1eb33-a4e8-4dd5-8659-d8b7535582c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:56.229125 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-48c1eb33-a4e8-4dd5-8659-d8b7535582c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:56.230258 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-48c1eb33-a4e8-4dd5-8659-d8b7535582c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1406 microversion: 2.20 time: 0.157568 May 25 15:06:56.230814 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 455/921] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:06:56 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:06:57.199561 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b00251ce-edc9-4062-9137-7cc34441151e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:57.200113 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-b00251ce-edc9-4062-9137-7cc34441151e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:57.206664 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b00251ce-edc9-4062-9137-7cc34441151e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:57.207114 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b00251ce-edc9-4062-9137-7cc34441151e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:57.207887 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b00251ce-edc9-4062-9137-7cc34441151e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:57.208330 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b00251ce-edc9-4062-9137-7cc34441151e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:57.247731 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a720990b-577c-4754-b390-6750e492c202 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:57.248331 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-a720990b-577c-4754-b390-6750e492c202 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:57.254899 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a720990b-577c-4754-b390-6750e492c202 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:57.255346 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a720990b-577c-4754-b390-6750e492c202 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:57.256104 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a720990b-577c-4754-b390-6750e492c202 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:57.256532 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a720990b-577c-4754-b390-6750e492c202 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:57.352353 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-b00251ce-edc9-4062-9137-7cc34441151e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:57.360570 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-b00251ce-edc9-4062-9137-7cc34441151e tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1756 microversion: 2.1 time: 0.164881 May 25 15:06:57.361148 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 467/922] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:06:57 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:57.387752 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-a720990b-577c-4754-b390-6750e492c202 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:57.395643 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-a720990b-577c-4754-b390-6750e492c202 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:57.397148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-a720990b-577c-4754-b390-6750e492c202 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:57.398940 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-a720990b-577c-4754-b390-6750e492c202 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1598 microversion: 2.20 time: 0.155067 May 25 15:06:57.399500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 456/923] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:06:57 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:06:57.415795 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-c09880fb-80b2-4fa9-8581-a5a2fb04ceb9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:57.416288 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-c09880fb-80b2-4fa9-8581-a5a2fb04ceb9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:57.423174 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c09880fb-80b2-4fa9-8581-a5a2fb04ceb9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:57.423703 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c09880fb-80b2-4fa9-8581-a5a2fb04ceb9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:57.424519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c09880fb-80b2-4fa9-8581-a5a2fb04ceb9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:57.424991 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c09880fb-80b2-4fa9-8581-a5a2fb04ceb9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:57.505034 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-c09880fb-80b2-4fa9-8581-a5a2fb04ceb9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093054 May 25 15:06:57.505676 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 468/924] 10.222.0.78 () {60 vars in 1315 bytes} [Wed May 25 15:06:57 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:06:58.378362 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-069d7ec5-6bbc-4d62-a903-7b144bc3afa6 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:58.378362 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-069d7ec5-6bbc-4d62-a903-7b144bc3afa6 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:58.389174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-069d7ec5-6bbc-4d62-a903-7b144bc3afa6 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:58.389798 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-069d7ec5-6bbc-4d62-a903-7b144bc3afa6 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:58.390422 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-069d7ec5-6bbc-4d62-a903-7b144bc3afa6 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:58.391158 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-069d7ec5-6bbc-4d62-a903-7b144bc3afa6 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:58.425966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-b951e8c1-4b60-4717-b2f0-e5c432c33148 req-fc8b5b66-9c7f-4522-a946-c770eba6c71e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4202b1b8-016d-4d26-ad4a-a2d3f6b58c65", "tag": "e6550da8-2d3f-49e5-ba79-3b3fb3daaf6a"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:06:58.434930 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-b951e8c1-4b60-4717-b2f0-e5c432c33148 req-fc8b5b66-9c7f-4522-a946-c770eba6c71e service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:58.435592 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-b951e8c1-4b60-4717-b2f0-e5c432c33148 req-fc8b5b66-9c7f-4522-a946-c770eba6c71e service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:58.447625 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-b951e8c1-4b60-4717-b2f0-e5c432c33148 req-fc8b5b66-9c7f-4522-a946-c770eba6c71e service nova] Creating event network-changed:e6550da8-2d3f-49e5-ba79-3b3fb3daaf6a for instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 on hv-cinder-80382 May 25 15:06:58.452722 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-b951e8c1-4b60-4717-b2f0-e5c432c33148 req-fc8b5b66-9c7f-4522-a946-c770eba6c71e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032562 May 25 15:06:58.453499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 469/925] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:06:58.563321 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-069d7ec5-6bbc-4d62-a903-7b144bc3afa6 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:58.572026 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-069d7ec5-6bbc-4d62-a903-7b144bc3afa6 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1756 microversion: 2.1 time: 0.198362 May 25 15:06:58.572599 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 457/926] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:06:58 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1756 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:59.590296 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0d9e2105-1a83-4512-bb78-7e27b534bce8 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:59.591082 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-0d9e2105-1a83-4512-bb78-7e27b534bce8 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:59.597355 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0d9e2105-1a83-4512-bb78-7e27b534bce8 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:59.597793 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0d9e2105-1a83-4512-bb78-7e27b534bce8 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:59.598654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0d9e2105-1a83-4512-bb78-7e27b534bce8 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:59.599085 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0d9e2105-1a83-4512-bb78-7e27b534bce8 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:59.790731 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-0d9e2105-1a83-4512-bb78-7e27b534bce8 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:59.799513 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-0d9e2105-1a83-4512-bb78-7e27b534bce8 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1759 microversion: 2.1 time: 0.214505 May 25 15:06:59.800079 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 470/927] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:06:59 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1759 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:26.559049 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-f820317b-4d73-4247-9132-4f2fd4dc820c tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:26.559756 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-f820317b-4d73-4247-9132-4f2fd4dc820c tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:26.560240 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-474049b0-fa84-4a3e-9dc3-9f37a542551d req-98696322-0dd5-48dc-aacf-559d7a66d4cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ab710e-55b1-4cab-861c-4df85276e296", "tag": "af13f183-e203-48b0-88ea-6554e58e9b95"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:07:26.562723 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:26.563479 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=39 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:26.566572 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:26.567766 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=26 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:26.575617 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-474049b0-fa84-4a3e-9dc3-9f37a542551d req-98696322-0dd5-48dc-aacf-559d7a66d4cf service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:26.576208 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-474049b0-fa84-4a3e-9dc3-9f37a542551d req-98696322-0dd5-48dc-aacf-559d7a66d4cf service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:26.578148 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f820317b-4d73-4247-9132-4f2fd4dc820c tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:26.579051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f820317b-4d73-4247-9132-4f2fd4dc820c tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:26.580353 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f820317b-4d73-4247-9132-4f2fd4dc820c tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:26.581381 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f820317b-4d73-4247-9132-4f2fd4dc820c tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:26.591026 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-474049b0-fa84-4a3e-9dc3-9f37a542551d req-98696322-0dd5-48dc-aacf-559d7a66d4cf service nova] Creating event network-changed:af13f183-e203-48b0-88ea-6554e58e9b95 for instance c0ab710e-55b1-4cab-861c-4df85276e296 on hv-cinder-80382 May 25 15:07:26.597023 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-474049b0-fa84-4a3e-9dc3-9f37a542551d req-98696322-0dd5-48dc-aacf-559d7a66d4cf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040368 May 25 15:07:26.597926 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 471/928] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:07:26.626356 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-f820317b-4d73-4247-9132-4f2fd4dc820c tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Going to try to terminate instance {{(pid=124524) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:07:26.724719 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-f820317b-4d73-4247-9132-4f2fd4dc820c tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 204 len: 0 microversion: 2.1 time: 0.170304 May 25 15:07:26.725790 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 458/929] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:07:26 2022] DELETE /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:07:26.735601 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0a336702-f2af-42af-9082-9c29c2fb27a4 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:26.736318 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-0a336702-f2af-42af-9082-9c29c2fb27a4 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:26.743013 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0a336702-f2af-42af-9082-9c29c2fb27a4 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:26.743828 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0a336702-f2af-42af-9082-9c29c2fb27a4 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:26.744367 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0a336702-f2af-42af-9082-9c29c2fb27a4 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:26.744697 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0a336702-f2af-42af-9082-9c29c2fb27a4 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:26.930434 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-0a336702-f2af-42af-9082-9c29c2fb27a4 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:26.944904 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-0a336702-f2af-42af-9082-9c29c2fb27a4 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1579 microversion: 2.1 time: 0.214202 May 25 15:07:26.946049 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 472/930] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:07:26 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1579 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:27.965986 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6f0c1898-c7a1-4a2f-9d32-4d4db176f8e2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:27.966756 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6f0c1898-c7a1-4a2f-9d32-4d4db176f8e2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:27.973300 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6f0c1898-c7a1-4a2f-9d32-4d4db176f8e2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:27.973748 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6f0c1898-c7a1-4a2f-9d32-4d4db176f8e2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:27.974555 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6f0c1898-c7a1-4a2f-9d32-4d4db176f8e2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:27.974990 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6f0c1898-c7a1-4a2f-9d32-4d4db176f8e2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:28.114602 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6f0c1898-c7a1-4a2f-9d32-4d4db176f8e2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:28.122477 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6f0c1898-c7a1-4a2f-9d32-4d4db176f8e2 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1579 microversion: 2.1 time: 0.161220 May 25 15:07:28.123050 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 459/931] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:07:27 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:29.141210 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a8646a7f-4747-4741-b697-78b62f165061 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:29.141997 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a8646a7f-4747-4741-b697-78b62f165061 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:29.149925 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a8646a7f-4747-4741-b697-78b62f165061 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:29.151007 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a8646a7f-4747-4741-b697-78b62f165061 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:29.151784 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a8646a7f-4747-4741-b697-78b62f165061 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:29.152217 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a8646a7f-4747-4741-b697-78b62f165061 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:29.384644 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a8646a7f-4747-4741-b697-78b62f165061 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:29.392926 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a8646a7f-4747-4741-b697-78b62f165061 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1460 microversion: 2.1 time: 0.256715 May 25 15:07:29.393504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 473/932] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:07:29 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1460 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:29.558077 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-7ba350bf-6c0e-4c89-8e75-b6215b9ade87 req-b576dbe0-9a02-4b33-b49a-7c73478b439b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ab710e-55b1-4cab-861c-4df85276e296", "name": "network-vif-deleted", "tag": "af13f183-e203-48b0-88ea-6554e58e9b95"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:07:29.567157 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-7ba350bf-6c0e-4c89-8e75-b6215b9ade87 req-b576dbe0-9a02-4b33-b49a-7c73478b439b service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:29.567609 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-7ba350bf-6c0e-4c89-8e75-b6215b9ade87 req-b576dbe0-9a02-4b33-b49a-7c73478b439b service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:29.579537 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-7ba350bf-6c0e-4c89-8e75-b6215b9ade87 req-b576dbe0-9a02-4b33-b49a-7c73478b439b service nova] Creating event network-vif-deleted:af13f183-e203-48b0-88ea-6554e58e9b95 for instance c0ab710e-55b1-4cab-861c-4df85276e296 on hv-cinder-80382 May 25 15:07:29.584408 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-7ba350bf-6c0e-4c89-8e75-b6215b9ade87 req-b576dbe0-9a02-4b33-b49a-7c73478b439b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030005 May 25 15:07:29.585022 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 460/933] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:07:30.410348 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f38a5ddd-a6e8-4b35-8104-58b1b055da81 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:30.410935 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f38a5ddd-a6e8-4b35-8104-58b1b055da81 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:30.417465 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f38a5ddd-a6e8-4b35-8104-58b1b055da81 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:30.417908 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f38a5ddd-a6e8-4b35-8104-58b1b055da81 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:30.418695 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f38a5ddd-a6e8-4b35-8104-58b1b055da81 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:30.419125 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f38a5ddd-a6e8-4b35-8104-58b1b055da81 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:30.451092 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f38a5ddd-a6e8-4b35-8104-58b1b055da81 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:30.451590 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f38a5ddd-a6e8-4b35-8104-58b1b055da81 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:30.452016 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.objects.instance [None req-f38a5ddd-a6e8-4b35-8104-58b1b055da81 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lazy-loading 'fault' on Instance uuid c0ab710e-55b1-4cab-861c-4df85276e296 {{(pid=124523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:07:30.497029 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f38a5ddd-a6e8-4b35-8104-58b1b055da81 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:30.504775 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f38a5ddd-a6e8-4b35-8104-58b1b055da81 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 200 len: 1231 microversion: 2.1 time: 0.098501 May 25 15:07:30.505349 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 474/934] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:07:30 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:31.523680 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a85f2fde-3925-449f-a0ab-eb4bcad92c49 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:31.524372 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-a85f2fde-3925-449f-a0ab-eb4bcad92c49 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: c0ab710e-55b1-4cab-861c-4df85276e296] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:31.530687 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a85f2fde-3925-449f-a0ab-eb4bcad92c49 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:31.531129 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a85f2fde-3925-449f-a0ab-eb4bcad92c49 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:31.531884 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a85f2fde-3925-449f-a0ab-eb4bcad92c49 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:31.532310 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-a85f2fde-3925-449f-a0ab-eb4bcad92c49 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:31.546556 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-a85f2fde-3925-449f-a0ab-eb4bcad92c49 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] HTTP exception thrown: Instance c0ab710e-55b1-4cab-861c-4df85276e296 could not be found. May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a85f2fde-3925-449f-a0ab-eb4bcad92c49 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Request method failure captured: May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 HTTP/1.1 May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkQ1prV8xU0Wo0Y4voiA4DMrSg8qtdpeFKsCNklPCcf4DhabLsXL6QoAbAPuEwQRJiIWdvqkyI-hcw3ve1R5P0sRHip2fx88sEnqgX_8vHJUlAZaRUFEpLg41eBW6uQegRbLJUSLaGoRBuQfVwMwipnGrfsThgts1b4ydwmnC9XN6NU May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 99281bdc8f6340a1be03774c255ae4ba May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-TestVolumeBootPattern-150097606 May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:07:31.548174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:07:31.550329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_99281bdc8f6340a1be03774c255ae4ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/99281bdc8f6340a1be03774c255ae4ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99281bdc8f6340a1be03774c255ae4ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99281bdc8f6340a1be03774c255ae4ba"}]}] May 25 15:07:31.550329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-TestVolumeBootPattern-150097606 May 25 15:07:31.550329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 99281bdc8f6340a1be03774c255ae4ba May 25 15:07:31.550329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-TestVolumeBootPattern-150097606 May 25 15:07:31.550329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-TestVolumeBootPattern-150097606-project May 25 15:07:31.550329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:07:31.550329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:07:31.550329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: daec78050ee547699910603eff8cb7ca May 25 15:07:31.550329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-TestVolumeBootPattern-150097606-project May 25 15:07:31.550329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:07:31.550329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance c0ab710e-55b1-4cab-861c-4df85276e296 could not be found. May 25 15:07:31.550329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': 'c0ab710e-55b1-4cab-861c-4df85276e296'} May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0ab710e-55b1-4cab-861c-4df85276e296 could not be found. May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:07:31.551375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:07:31.553042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:07:31.553042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:07:31.553042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:07:31.553042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:07:31.553042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:07:31.553042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:07:31.553042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:07:31.553042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0ab710e-55b1-4cab-861c-4df85276e296 could not be found. May 25 15:07:31.553042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:07:31.553042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:07:31.553042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:07:31.553042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:31.553042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:07:31.553042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:07:31.553042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:07:31.553042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:07:31.553042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0ab710e-55b1-4cab-861c-4df85276e296 could not be found. May 25 15:07:31.553042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:07:31.554866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-a85f2fde-3925-449f-a0ab-eb4bcad92c49 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Returning 404 to user: Instance c0ab710e-55b1-4cab-861c-4df85276e296 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:07:31.554866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-a85f2fde-3925-449f-a0ab-eb4bcad92c49 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296" status: 404 len: 111 microversion: 2.1 time: 0.030779 May 25 15:07:31.554866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 461/935] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:07:31 2022] GET /compute/v2.1/servers/c0ab710e-55b1-4cab-861c-4df85276e296 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:07:34.639956 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a8b822fe-e53f-41e6-b6a5-6251390792b9 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:34.640371 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a8b822fe-e53f-41e6-b6a5-6251390792b9 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:34.647294 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a8b822fe-e53f-41e6-b6a5-6251390792b9 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:34.647957 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a8b822fe-e53f-41e6-b6a5-6251390792b9 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:34.648743 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a8b822fe-e53f-41e6-b6a5-6251390792b9 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:34.649176 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a8b822fe-e53f-41e6-b6a5-6251390792b9 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:34.655498 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-edea2b7c-8a82-4687-b719-bcc5116f3b86 req-0687ac6e-276b-4759-91dd-7c29ccbbc75f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62cd86f-b289-4006-bd52-2dad10b43e93", "tag": "fd6e6b51-3ed9-43c2-8f3a-8d7ad380c206"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:07:34.665533 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-edea2b7c-8a82-4687-b719-bcc5116f3b86 req-0687ac6e-276b-4759-91dd-7c29ccbbc75f service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:34.665970 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-edea2b7c-8a82-4687-b719-bcc5116f3b86 req-0687ac6e-276b-4759-91dd-7c29ccbbc75f service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:34.677776 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-edea2b7c-8a82-4687-b719-bcc5116f3b86 req-0687ac6e-276b-4759-91dd-7c29ccbbc75f service nova] Creating event network-changed:fd6e6b51-3ed9-43c2-8f3a-8d7ad380c206 for instance d62cd86f-b289-4006-bd52-2dad10b43e93 on hv-cinder-80382 May 25 15:07:34.678636 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a8b822fe-e53f-41e6-b6a5-6251390792b9 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Going to try to terminate instance {{(pid=124523) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:07:34.683185 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-edea2b7c-8a82-4687-b719-bcc5116f3b86 req-0687ac6e-276b-4759-91dd-7c29ccbbc75f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032464 May 25 15:07:34.684078 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 462/936] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:07:34.925429 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a8b822fe-e53f-41e6-b6a5-6251390792b9 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 204 len: 0 microversion: 2.1 time: 0.289773 May 25 15:07:34.926026 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 475/937] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:07:34 2022] DELETE /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 15:07:34.935176 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-77c5d794-7cfd-4d24-9fcd-6053f5de96ab tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:34.935889 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-77c5d794-7cfd-4d24-9fcd-6053f5de96ab tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:34.942894 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-77c5d794-7cfd-4d24-9fcd-6053f5de96ab tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:34.943377 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-77c5d794-7cfd-4d24-9fcd-6053f5de96ab tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:34.944162 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-77c5d794-7cfd-4d24-9fcd-6053f5de96ab tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:34.944820 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-77c5d794-7cfd-4d24-9fcd-6053f5de96ab tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:35.093496 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-77c5d794-7cfd-4d24-9fcd-6053f5de96ab tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:35.101142 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-77c5d794-7cfd-4d24-9fcd-6053f5de96ab tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1578 microversion: 2.1 time: 0.170513 May 25 15:07:35.110803 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 463/938] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:07:34 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:36.119188 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-1143264e-a0a2-4463-9c4b-6ee1056d78ca tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:36.119920 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-1143264e-a0a2-4463-9c4b-6ee1056d78ca tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:36.127474 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1143264e-a0a2-4463-9c4b-6ee1056d78ca tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:36.128095 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1143264e-a0a2-4463-9c4b-6ee1056d78ca tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:36.128800 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1143264e-a0a2-4463-9c4b-6ee1056d78ca tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:36.129325 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1143264e-a0a2-4463-9c4b-6ee1056d78ca tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:36.262357 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-1143264e-a0a2-4463-9c4b-6ee1056d78ca tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:36.271088 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-1143264e-a0a2-4463-9c4b-6ee1056d78ca tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1578 microversion: 2.1 time: 0.156063 May 25 15:07:36.271688 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 476/939] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:07:36 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:37.288400 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-dbed4ea4-f73f-4818-8c42-05cfd961f4fc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:37.289008 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-dbed4ea4-f73f-4818-8c42-05cfd961f4fc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:37.296281 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dbed4ea4-f73f-4818-8c42-05cfd961f4fc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:37.296729 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dbed4ea4-f73f-4818-8c42-05cfd961f4fc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:37.297508 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dbed4ea4-f73f-4818-8c42-05cfd961f4fc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:37.297938 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-dbed4ea4-f73f-4818-8c42-05cfd961f4fc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:37.432216 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-dbed4ea4-f73f-4818-8c42-05cfd961f4fc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:37.439631 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-dbed4ea4-f73f-4818-8c42-05cfd961f4fc tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1459 microversion: 2.1 time: 0.155204 May 25 15:07:37.440199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 464/940] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:07:37 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1459 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:37.748969 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-8d98cbdb-c759-4f13-8007-a4d8f7fef394 req-67f70739-bf03-485f-86e3-bd45ad854a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62cd86f-b289-4006-bd52-2dad10b43e93", "name": "network-vif-deleted", "tag": "fd6e6b51-3ed9-43c2-8f3a-8d7ad380c206"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:07:37.760303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-8d98cbdb-c759-4f13-8007-a4d8f7fef394 req-67f70739-bf03-485f-86e3-bd45ad854a9b service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:37.760754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-8d98cbdb-c759-4f13-8007-a4d8f7fef394 req-67f70739-bf03-485f-86e3-bd45ad854a9b service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:37.776131 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-8d98cbdb-c759-4f13-8007-a4d8f7fef394 req-67f70739-bf03-485f-86e3-bd45ad854a9b service nova] Creating event network-vif-deleted:fd6e6b51-3ed9-43c2-8f3a-8d7ad380c206 for instance d62cd86f-b289-4006-bd52-2dad10b43e93 on hv-cinder-80382 May 25 15:07:37.782217 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-8d98cbdb-c759-4f13-8007-a4d8f7fef394 req-67f70739-bf03-485f-86e3-bd45ad854a9b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036682 May 25 15:07:37.783097 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 477/941] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:07:38.456853 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-6dbddd37-24f7-41f4-a3a9-de60b6c9ddff tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:38.457397 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-6dbddd37-24f7-41f4-a3a9-de60b6c9ddff tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:38.463834 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6dbddd37-24f7-41f4-a3a9-de60b6c9ddff tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:38.464282 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6dbddd37-24f7-41f4-a3a9-de60b6c9ddff tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:38.465035 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6dbddd37-24f7-41f4-a3a9-de60b6c9ddff tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:38.465463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6dbddd37-24f7-41f4-a3a9-de60b6c9ddff tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:38.495228 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6dbddd37-24f7-41f4-a3a9-de60b6c9ddff tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:38.495668 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-6dbddd37-24f7-41f4-a3a9-de60b6c9ddff tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:38.496107 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-6dbddd37-24f7-41f4-a3a9-de60b6c9ddff tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lazy-loading 'fault' on Instance uuid d62cd86f-b289-4006-bd52-2dad10b43e93 {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:07:38.538660 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-6dbddd37-24f7-41f4-a3a9-de60b6c9ddff tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daec78050ee547699910603eff8cb7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99281bdc8f6340a1be03774c255ae4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:38.546700 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-6dbddd37-24f7-41f4-a3a9-de60b6c9ddff tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 200 len: 1231 microversion: 2.1 time: 0.093796 May 25 15:07:38.547270 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 465/942] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:07:38 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:39.564654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b714fa4d-55e9-45a3-b480-6791b2a00745 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:39.565382 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-b714fa4d-55e9-45a3-b480-6791b2a00745 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: d62cd86f-b289-4006-bd52-2dad10b43e93] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:39.572169 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b714fa4d-55e9-45a3-b480-6791b2a00745 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:39.572611 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b714fa4d-55e9-45a3-b480-6791b2a00745 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:39.573367 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b714fa4d-55e9-45a3-b480-6791b2a00745 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:39.573797 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b714fa4d-55e9-45a3-b480-6791b2a00745 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:39.587363 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-b714fa4d-55e9-45a3-b480-6791b2a00745 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] HTTP exception thrown: Instance d62cd86f-b289-4006-bd52-2dad10b43e93 could not be found. May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b714fa4d-55e9-45a3-b480-6791b2a00745 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Request method failure captured: May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 HTTP/1.1 May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkQ1prV8xU0Wo0Y4voiA4DMrSg8qtdpeFKsCNklPCcf4DhabLsXL6QoAbAPuEwQRJiIWdvqkyI-hcw3ve1R5P0sRHip2fx88sEnqgX_8vHJUlAZaRUFEpLg41eBW6uQegRbLJUSLaGoRBuQfVwMwipnGrfsThgts1b4ydwmnC9XN6NU May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 99281bdc8f6340a1be03774c255ae4ba May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-TestVolumeBootPattern-150097606 May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:07:39.588975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:07:39.590574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_99281bdc8f6340a1be03774c255ae4ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/99281bdc8f6340a1be03774c255ae4ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99281bdc8f6340a1be03774c255ae4ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99281bdc8f6340a1be03774c255ae4ba"}]}] May 25 15:07:39.590574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-TestVolumeBootPattern-150097606 May 25 15:07:39.590574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 99281bdc8f6340a1be03774c255ae4ba May 25 15:07:39.590574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-TestVolumeBootPattern-150097606 May 25 15:07:39.590574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-TestVolumeBootPattern-150097606-project May 25 15:07:39.590574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:07:39.590574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:07:39.590574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: daec78050ee547699910603eff8cb7ca May 25 15:07:39.590574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-TestVolumeBootPattern-150097606-project May 25 15:07:39.590574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:07:39.590574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance d62cd86f-b289-4006-bd52-2dad10b43e93 could not be found. May 25 15:07:39.590574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': 'd62cd86f-b289-4006-bd52-2dad10b43e93'} May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d62cd86f-b289-4006-bd52-2dad10b43e93 could not be found. May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:07:39.591499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:07:39.593151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:07:39.593151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:07:39.593151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:07:39.593151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:07:39.593151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:07:39.593151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:07:39.593151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:07:39.593151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d62cd86f-b289-4006-bd52-2dad10b43e93 could not be found. May 25 15:07:39.593151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:07:39.593151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:07:39.593151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:07:39.593151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:39.593151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:07:39.593151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:07:39.593151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:07:39.593151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:07:39.593151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d62cd86f-b289-4006-bd52-2dad10b43e93 could not be found. May 25 15:07:39.593151 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:07:39.596728 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b714fa4d-55e9-45a3-b480-6791b2a00745 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Returning 404 to user: Instance d62cd86f-b289-4006-bd52-2dad10b43e93 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:07:39.596728 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-b714fa4d-55e9-45a3-b480-6791b2a00745 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93" status: 404 len: 111 microversion: 2.1 time: 0.030554 May 25 15:07:39.596728 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 478/943] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:07:39 2022] GET /compute/v2.1/servers/d62cd86f-b289-4006-bd52-2dad10b43e93 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:07:39.597470 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1bc464c0-4e26-4041-b2d8-d4207b7eb312 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-848098611"}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:07:39.597470 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1bc464c0-4e26-4041-b2d8-d4207b7eb312 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:39.603811 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1bc464c0-4e26-4041-b2d8-d4207b7eb312 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:39.604264 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1bc464c0-4e26-4041-b2d8-d4207b7eb312 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:39.605044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1bc464c0-4e26-4041-b2d8-d4207b7eb312 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:39.605480 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1bc464c0-4e26-4041-b2d8-d4207b7eb312 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:39.841429 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.network.security_group_api [None req-1bc464c0-4e26-4041-b2d8-d4207b7eb312 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Removing security group 6de920ad-333d-4f10-8a18-a2e9860b1a0e from port 14bd1814-6415-4936-8dc1-ab3f7060d8b1 May 25 15:07:40.396503 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-1599335e-9a0e-404b-b6d6-57d82b9ce736 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:40.397235 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-1599335e-9a0e-404b-b6d6-57d82b9ce736 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:40.404178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1599335e-9a0e-404b-b6d6-57d82b9ce736 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:40.404693 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1599335e-9a0e-404b-b6d6-57d82b9ce736 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:40.405473 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1599335e-9a0e-404b-b6d6-57d82b9ce736 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:40.405905 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1599335e-9a0e-404b-b6d6-57d82b9ce736 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:40.436635 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-1599335e-9a0e-404b-b6d6-57d82b9ce736 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] HTTP exception thrown: Instance a712db2a-4e2e-46b3-a696-9396ea8c5209 could not be found. May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-1599335e-9a0e-404b-b6d6-57d82b9ce736 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Request method failure captured: May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: DELETE /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 HTTP/1.1 May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkQ1prV8xU0Wo0Y4voiA4DMrSg8qtdpeFKsCNklPCcf4DhabLsXL6QoAbAPuEwQRJiIWdvqkyI-hcw3ve1R5P0sRHip2fx88sEnqgX_8vHJUlAZaRUFEpLg41eBW6uQegRbLJUSLaGoRBuQfVwMwipnGrfsThgts1b4ydwmnC9XN6NU May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 99281bdc8f6340a1be03774c255ae4ba May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-TestVolumeBootPattern-150097606 May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:07:40.440631 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:07:40.442469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_99281bdc8f6340a1be03774c255ae4ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/99281bdc8f6340a1be03774c255ae4ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99281bdc8f6340a1be03774c255ae4ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99281bdc8f6340a1be03774c255ae4ba"}]}] May 25 15:07:40.442469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-TestVolumeBootPattern-150097606 May 25 15:07:40.442469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 99281bdc8f6340a1be03774c255ae4ba May 25 15:07:40.442469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-TestVolumeBootPattern-150097606 May 25 15:07:40.442469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-TestVolumeBootPattern-150097606-project May 25 15:07:40.442469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:07:40.442469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:07:40.442469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: daec78050ee547699910603eff8cb7ca May 25 15:07:40.442469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-TestVolumeBootPattern-150097606-project May 25 15:07:40.442469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:07:40.442469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance a712db2a-4e2e-46b3-a696-9396ea8c5209 could not be found. May 25 15:07:40.442469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': 'a712db2a-4e2e-46b3-a696-9396ea8c5209'} May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a712db2a-4e2e-46b3-a696-9396ea8c5209 could not be found. May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:07:40.443311 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a712db2a-4e2e-46b3-a696-9396ea8c5209 could not be found. May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a712db2a-4e2e-46b3-a696-9396ea8c5209 could not be found. May 25 15:07:40.444588 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:07:40.445903 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-1599335e-9a0e-404b-b6d6-57d82b9ce736 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Returning 404 to user: Instance a712db2a-4e2e-46b3-a696-9396ea8c5209 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:07:40.445903 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-1599335e-9a0e-404b-b6d6-57d82b9ce736 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 404 len: 111 microversion: 2.1 time: 0.051222 May 25 15:07:40.445903 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 479/944] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:07:40 2022] DELETE /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:07:40.453773 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-52e46e99-1089-4371-9ecc-ce337c29c6ca tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:40.454458 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-52e46e99-1089-4371-9ecc-ce337c29c6ca tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] [instance: a712db2a-4e2e-46b3-a696-9396ea8c5209] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:40.460817 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-52e46e99-1089-4371-9ecc-ce337c29c6ca tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:40.461273 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-52e46e99-1089-4371-9ecc-ce337c29c6ca tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:40.462102 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-52e46e99-1089-4371-9ecc-ce337c29c6ca tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:40.462544 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-52e46e99-1089-4371-9ecc-ce337c29c6ca tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:40.477753 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-52e46e99-1089-4371-9ecc-ce337c29c6ca tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] HTTP exception thrown: Instance a712db2a-4e2e-46b3-a696-9396ea8c5209 could not be found. May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-52e46e99-1089-4371-9ecc-ce337c29c6ca tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Request method failure captured: May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 HTTP/1.1 May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkQ1prV8xU0Wo0Y4voiA4DMrSg8qtdpeFKsCNklPCcf4DhabLsXL6QoAbAPuEwQRJiIWdvqkyI-hcw3ve1R5P0sRHip2fx88sEnqgX_8vHJUlAZaRUFEpLg41eBW6uQegRbLJUSLaGoRBuQfVwMwipnGrfsThgts1b4ydwmnC9XN6NU May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 99281bdc8f6340a1be03774c255ae4ba May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-TestVolumeBootPattern-150097606 May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:07:40.479641 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:07:40.482540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_99281bdc8f6340a1be03774c255ae4ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/99281bdc8f6340a1be03774c255ae4ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99281bdc8f6340a1be03774c255ae4ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99281bdc8f6340a1be03774c255ae4ba"}]}] May 25 15:07:40.482540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-TestVolumeBootPattern-150097606 May 25 15:07:40.482540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 99281bdc8f6340a1be03774c255ae4ba May 25 15:07:40.482540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-TestVolumeBootPattern-150097606 May 25 15:07:40.482540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-TestVolumeBootPattern-150097606-project May 25 15:07:40.482540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:07:40.482540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:07:40.482540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: daec78050ee547699910603eff8cb7ca May 25 15:07:40.482540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-TestVolumeBootPattern-150097606-project May 25 15:07:40.482540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:07:40.482540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance a712db2a-4e2e-46b3-a696-9396ea8c5209 could not be found. May 25 15:07:40.482540 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': 'a712db2a-4e2e-46b3-a696-9396ea8c5209'} May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a712db2a-4e2e-46b3-a696-9396ea8c5209 could not be found. May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:07:40.484327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:07:40.489675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:07:40.489675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:07:40.489675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:07:40.489675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:07:40.489675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:07:40.489675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:07:40.489675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:07:40.489675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a712db2a-4e2e-46b3-a696-9396ea8c5209 could not be found. May 25 15:07:40.489675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:07:40.489675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:07:40.489675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:07:40.489675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:40.489675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:07:40.489675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:07:40.489675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:07:40.489675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:07:40.489675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a712db2a-4e2e-46b3-a696-9396ea8c5209 could not be found. May 25 15:07:40.489675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:07:40.500877 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-52e46e99-1089-4371-9ecc-ce337c29c6ca tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Returning 404 to user: Instance a712db2a-4e2e-46b3-a696-9396ea8c5209 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:07:40.501160 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1bc464c0-4e26-4041-b2d8-d4207b7eb312 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "POST /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/action" status: 202 len: 0 microversion: 2.1 time: 0.887321 May 25 15:07:40.501345 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-52e46e99-1089-4371-9ecc-ce337c29c6ca tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209" status: 404 len: 111 microversion: 2.1 time: 0.031717 May 25 15:07:40.501345 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 480/945] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:07:40 2022] GET /compute/v2.1/servers/a712db2a-4e2e-46b3-a696-9396ea8c5209 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:07:40.501698 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 466/946] 10.222.0.78 () {60 vars in 1277 bytes} [Wed May 25 15:07:39 2022] POST /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/action => generated 0 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:07:40.748568 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-4b7e01c7-9a3c-4826-8e6a-bff1896097a5 req-bc27e790-9b2f-4bc2-a102-be5a63b38a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aef5cf9-818a-4b1b-8305-258790e3845d", "tag": "14bd1814-6415-4936-8dc1-ab3f7060d8b1"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:07:40.772582 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-4b7e01c7-9a3c-4826-8e6a-bff1896097a5 req-bc27e790-9b2f-4bc2-a102-be5a63b38a69 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:40.773268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-4b7e01c7-9a3c-4826-8e6a-bff1896097a5 req-bc27e790-9b2f-4bc2-a102-be5a63b38a69 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:40.798950 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-4b7e01c7-9a3c-4826-8e6a-bff1896097a5 req-bc27e790-9b2f-4bc2-a102-be5a63b38a69 service nova] Creating event network-changed:14bd1814-6415-4936-8dc1-ab3f7060d8b1 for instance 5aef5cf9-818a-4b1b-8305-258790e3845d on hv-cinder-80382 May 25 15:07:40.805733 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-4b7e01c7-9a3c-4826-8e6a-bff1896097a5 req-bc27e790-9b2f-4bc2-a102-be5a63b38a69 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.288103 May 25 15:07:40.806917 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 481/947] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:07:41.946802 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-efc05048-57c8-4d86-992c-6a5b3187914e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:41.948678 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-efc05048-57c8-4d86-992c-6a5b3187914e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:41.960931 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-efc05048-57c8-4d86-992c-6a5b3187914e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:41.962433 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-efc05048-57c8-4d86-992c-6a5b3187914e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:41.965089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-efc05048-57c8-4d86-992c-6a5b3187914e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:41.966538 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-efc05048-57c8-4d86-992c-6a5b3187914e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:41.996657 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-cc2f549e-8293-4199-b59e-573e44824e51 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] Calling method '.version_select at 0x7fb1e415aee0>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:42.021048 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-efc05048-57c8-4d86-992c-6a5b3187914e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65/ips" status: 200 len: 151 microversion: 2.20 time: 0.082171 May 25 15:07:42.022591 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 467/948] 10.222.0.78 () {60 vars in 1288 bytes} [Wed May 25 15:07:41 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65/ips => generated 151 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:07:42.038080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-cc2f549e-8293-4199-b59e-573e44824e51 tempest-TestVolumeBootPattern-150097606 tempest-TestVolumeBootPattern-150097606-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1398894099" status: 202 len: 0 microversion: 2.1 time: 0.049538 May 25 15:07:42.042572 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 482/949] 10.222.0.78 () {58 vars in 1262 bytes} [Wed May 25 15:07:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1398894099 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 15:07:42.221529 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-e13c4a9e-bf21-408a-86a8-7a54880a3304 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:42.222474 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-e13c4a9e-bf21-408a-86a8-7a54880a3304 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:42.232936 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e13c4a9e-bf21-408a-86a8-7a54880a3304 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:42.234769 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e13c4a9e-bf21-408a-86a8-7a54880a3304 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:42.236675 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e13c4a9e-bf21-408a-86a8-7a54880a3304 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:42.237827 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e13c4a9e-bf21-408a-86a8-7a54880a3304 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:42.443234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-e13c4a9e-bf21-408a-86a8-7a54880a3304 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lazy-loading 'services' on Instance uuid 5aef5cf9-818a-4b1b-8305-258790e3845d {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:07:42.580829 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-e13c4a9e-bf21-408a-86a8-7a54880a3304 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/os-volume_attachments/c53616dc-e315-4135-b278-a14e5146f143" status: 202 len: 0 microversion: 2.1 time: 0.368044 May 25 15:07:42.581912 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 468/950] 10.222.0.78 () {58 vars in 1415 bytes} [Wed May 25 15:07:42 2022] DELETE /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/os-volume_attachments/c53616dc-e315-4135-b278-a14e5146f143 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:07:42.595470 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ab6add70-8dd9-4ef6-bff5-32eaeb4cdb97 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:42.597678 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ab6add70-8dd9-4ef6-bff5-32eaeb4cdb97 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:42.609772 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ab6add70-8dd9-4ef6-bff5-32eaeb4cdb97 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:42.610598 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ab6add70-8dd9-4ef6-bff5-32eaeb4cdb97 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:42.611992 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ab6add70-8dd9-4ef6-bff5-32eaeb4cdb97 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:42.612781 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ab6add70-8dd9-4ef6-bff5-32eaeb4cdb97 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:42.652572 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ab6add70-8dd9-4ef6-bff5-32eaeb4cdb97 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064729 May 25 15:07:42.658101 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 483/951] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:07:42 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:07:42.857857 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-2319b79e-664e-408a-ac22-69d4319417f7 req-9b75471e-de13-41da-b93a-79837c32d030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aef5cf9-818a-4b1b-8305-258790e3845d", "tag": "14bd1814-6415-4936-8dc1-ab3f7060d8b1"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:07:42.868199 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-2319b79e-664e-408a-ac22-69d4319417f7 req-9b75471e-de13-41da-b93a-79837c32d030 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:42.869097 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-2319b79e-664e-408a-ac22-69d4319417f7 req-9b75471e-de13-41da-b93a-79837c32d030 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:42.881396 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-2319b79e-664e-408a-ac22-69d4319417f7 req-9b75471e-de13-41da-b93a-79837c32d030 service nova] Creating event network-changed:14bd1814-6415-4936-8dc1-ab3f7060d8b1 for instance 5aef5cf9-818a-4b1b-8305-258790e3845d on hv-cinder-80382 May 25 15:07:42.887237 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-2319b79e-664e-408a-ac22-69d4319417f7 req-9b75471e-de13-41da-b93a-79837c32d030 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033455 May 25 15:07:42.888131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 469/952] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:07:43.665421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-834f228b-bff9-4f5a-8e27-3075905a08c7 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:43.666376 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-834f228b-bff9-4f5a-8e27-3075905a08c7 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:43.673123 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-834f228b-bff9-4f5a-8e27-3075905a08c7 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:43.673623 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-834f228b-bff9-4f5a-8e27-3075905a08c7 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:43.674490 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-834f228b-bff9-4f5a-8e27-3075905a08c7 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:43.674848 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-834f228b-bff9-4f5a-8e27-3075905a08c7 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:43.710305 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-834f228b-bff9-4f5a-8e27-3075905a08c7 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049245 May 25 15:07:43.710871 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 484/953] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:07:43 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:07:44.385223 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-bf0ec137-bd43-49ba-9536-4a40d50e1c6f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:07:44.386331 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-bf0ec137-bd43-49ba-9536-4a40d50e1c6f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:44.393289 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bf0ec137-bd43-49ba-9536-4a40d50e1c6f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:44.393734 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bf0ec137-bd43-49ba-9536-4a40d50e1c6f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:44.394544 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bf0ec137-bd43-49ba-9536-4a40d50e1c6f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:44.394973 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bf0ec137-bd43-49ba-9536-4a40d50e1c6f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:44.419472 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-bf0ec137-bd43-49ba-9536-4a40d50e1c6f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lazy-loading 'flavor' on Instance uuid 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:07:44.699980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-bf0ec137-bd43-49ba-9536-4a40d50e1c6f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "POST /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65/action" status: 202 len: 0 microversion: 2.20 time: 0.319972 May 25 15:07:44.701140 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 470/954] 10.222.0.78 () {62 vars in 1318 bytes} [Wed May 25 15:07:44 2022] POST /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 15:07:44.714276 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d206262d-5b39-430c-babe-e9b21a0b28c2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:44.715648 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d206262d-5b39-430c-babe-e9b21a0b28c2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:44.730118 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7ba3e065-aa0c-4421-8345-988fb0fa8dc5 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:44.731483 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7ba3e065-aa0c-4421-8345-988fb0fa8dc5 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:44.731712 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d206262d-5b39-430c-babe-e9b21a0b28c2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:44.732263 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d206262d-5b39-430c-babe-e9b21a0b28c2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:44.734272 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d206262d-5b39-430c-babe-e9b21a0b28c2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:44.734860 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d206262d-5b39-430c-babe-e9b21a0b28c2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:44.739898 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7ba3e065-aa0c-4421-8345-988fb0fa8dc5 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:44.740473 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7ba3e065-aa0c-4421-8345-988fb0fa8dc5 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:44.741457 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7ba3e065-aa0c-4421-8345-988fb0fa8dc5 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:44.742099 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7ba3e065-aa0c-4421-8345-988fb0fa8dc5 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:44.792646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7ba3e065-aa0c-4421-8345-988fb0fa8dc5 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072227 May 25 15:07:44.793588 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 471/955] 10.222.0.78 () {58 vars in 1301 bytes} [Wed May 25 15:07:44 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:07:44.804332 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1ff440c0-cf81-4b62-807c-f0d7539da1ba tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:44.806796 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1ff440c0-cf81-4b62-807c-f0d7539da1ba tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:44.814872 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1ff440c0-cf81-4b62-807c-f0d7539da1ba tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:44.815594 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1ff440c0-cf81-4b62-807c-f0d7539da1ba tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:44.816403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1ff440c0-cf81-4b62-807c-f0d7539da1ba tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:44.817346 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1ff440c0-cf81-4b62-807c-f0d7539da1ba tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:44.906092 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d206262d-5b39-430c-babe-e9b21a0b28c2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:44.911312 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-1ff440c0-cf81-4b62-807c-f0d7539da1ba tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] HTTP exception thrown: Instance 5aef5cf9-818a-4b1b-8305-258790e3845d is not attached to volume c53616dc-e315-4135-b278-a14e5146f143 May 25 15:07:44.914772 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d206262d-5b39-430c-babe-e9b21a0b28c2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:44.916282 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d206262d-5b39-430c-babe-e9b21a0b28c2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:44.917494 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d206262d-5b39-430c-babe-e9b21a0b28c2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.211838 May 25 15:07:44.918164 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 485/956] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:07:44 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1ff440c0-cf81-4b62-807c-f0d7539da1ba tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Request method failure captured: May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: DELETE /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/os-volume_attachments/c53616dc-e315-4135-b278-a14e5146f143 HTTP/1.1 May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkWbjydlJ6PvXFwoU4VLfpU7sNK6NYXuud5qAqwvV2G451TWh9lX4YBjH6fJ31Br92ERnUMz5GwnPN0uQyytJQPYMzwliaRuQbKmxZMJhkEcsky3h6rnEvUtq5Mqti5OnSgTsgYAOVB1uOtAZCRUZh6so6u7RzaN7nhIwJ4KH4QB4Pc May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 5e9e55701e7c4fe180a21d1934298240 May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-TestMinimumBasicScenario-1942380429 May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:07:44.920361 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:07:44.922646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5e9e55701e7c4fe180a21d1934298240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5e9e55701e7c4fe180a21d1934298240"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5e9e55701e7c4fe180a21d1934298240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5e9e55701e7c4fe180a21d1934298240"}]}] May 25 15:07:44.922646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-TestMinimumBasicScenario-1942380429 May 25 15:07:44.922646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 5e9e55701e7c4fe180a21d1934298240 May 25 15:07:44.922646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1942380429 May 25 15:07:44.922646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-TestMinimumBasicScenario-1942380429-project May 25 15:07:44.922646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:07:44.922646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:07:44.922646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: f892dfa98adb40198ce1296134d1263c May 25 15:07:44.922646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-TestMinimumBasicScenario-1942380429-project May 25 15:07:44.922646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:07:44.922646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance 5aef5cf9-818a-4b1b-8305-258790e3845d is not attached to volume c53616dc-e315-4135-b278-a14e5146f143 May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'server_id': '5aef5cf9-818a-4b1b-8305-258790e3845d', 'id': 'c53616dc-e315-4135-b278-a14e5146f143'} May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c53616dc-e315-4135-b278-a14e5146f143. May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:07:44.923570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:07:44.925043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:07:44.925043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 25 15:07:44.925043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 25 15:07:44.925043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aef5cf9-818a-4b1b-8305-258790e3845d is not attached to volume c53616dc-e315-4135-b278-a14e5146f143 May 25 15:07:44.925043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:07:44.925043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:07:44.925043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:07:44.925043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:44.925043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:07:44.925043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:07:44.925043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:07:44.925043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:07:44.925043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aef5cf9-818a-4b1b-8305-258790e3845d is not attached to volume c53616dc-e315-4135-b278-a14e5146f143 May 25 15:07:44.925043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:07:44.926929 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1ff440c0-cf81-4b62-807c-f0d7539da1ba tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Returning 404 to user: Instance 5aef5cf9-818a-4b1b-8305-258790e3845d is not attached to volume c53616dc-e315-4135-b278-a14e5146f143 {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:07:44.927963 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1ff440c0-cf81-4b62-807c-f0d7539da1ba tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/os-volume_attachments/c53616dc-e315-4135-b278-a14e5146f143" status: 404 len: 154 microversion: 2.1 time: 0.128416 May 25 15:07:44.928820 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 472/957] 10.222.0.78 () {58 vars in 1415 bytes} [Wed May 25 15:07:44 2022] DELETE /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d/os-volume_attachments/c53616dc-e315-4135-b278-a14e5146f143 => generated 154 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:07:45.937119 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a5dff07c-6ce4-4f10-a749-608bf6b5ce2a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:45.938397 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a5dff07c-6ce4-4f10-a749-608bf6b5ce2a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:45.945375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a5dff07c-6ce4-4f10-a749-608bf6b5ce2a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:45.945886 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a5dff07c-6ce4-4f10-a749-608bf6b5ce2a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:45.946793 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a5dff07c-6ce4-4f10-a749-608bf6b5ce2a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:45.947132 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a5dff07c-6ce4-4f10-a749-608bf6b5ce2a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:46.104965 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7da7f4b6-306d-43d4-9cc9-cef165590980 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:46.105451 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7da7f4b6-306d-43d4-9cc9-cef165590980 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:46.114349 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7da7f4b6-306d-43d4-9cc9-cef165590980 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:46.114798 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7da7f4b6-306d-43d4-9cc9-cef165590980 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:46.115586 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7da7f4b6-306d-43d4-9cc9-cef165590980 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:46.116018 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7da7f4b6-306d-43d4-9cc9-cef165590980 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:46.120690 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:46.125293 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a5dff07c-6ce4-4f10-a749-608bf6b5ce2a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:46.135378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a5dff07c-6ce4-4f10-a749-608bf6b5ce2a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:46.138199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a5dff07c-6ce4-4f10-a749-608bf6b5ce2a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:46.139887 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a5dff07c-6ce4-4f10-a749-608bf6b5ce2a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.207297 May 25 15:07:46.153716 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 486/958] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:07:45 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:07:46.157530 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7da7f4b6-306d-43d4-9cc9-cef165590980 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Going to try to terminate instance {{(pid=124524) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:07:46.262263 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7da7f4b6-306d-43d4-9cc9-cef165590980 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 204 len: 0 microversion: 2.1 time: 0.161407 May 25 15:07:46.263233 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 473/959] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:07:46 2022] DELETE /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 15:07:46.272521 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d417e2a1-508b-48d4-936f-f06c9085eac2 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:46.273678 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d417e2a1-508b-48d4-936f-f06c9085eac2 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:46.282169 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d417e2a1-508b-48d4-936f-f06c9085eac2 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:46.282618 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d417e2a1-508b-48d4-936f-f06c9085eac2 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:46.283408 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d417e2a1-508b-48d4-936f-f06c9085eac2 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:46.283840 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d417e2a1-508b-48d4-936f-f06c9085eac2 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:46.464688 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d417e2a1-508b-48d4-936f-f06c9085eac2 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:46.473171 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d417e2a1-508b-48d4-936f-f06c9085eac2 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1554 microversion: 2.1 time: 0.205283 May 25 15:07:46.479971 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 487/960] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:07:46 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1554 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:47.162624 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-82a4475d-c28b-4518-a7d1-3853a19a84e5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:47.163323 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-82a4475d-c28b-4518-a7d1-3853a19a84e5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:47.169842 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-82a4475d-c28b-4518-a7d1-3853a19a84e5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:47.170398 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-82a4475d-c28b-4518-a7d1-3853a19a84e5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:47.171219 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-82a4475d-c28b-4518-a7d1-3853a19a84e5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:47.171640 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-82a4475d-c28b-4518-a7d1-3853a19a84e5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:47.378477 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-82a4475d-c28b-4518-a7d1-3853a19a84e5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:47.388271 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-82a4475d-c28b-4518-a7d1-3853a19a84e5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:47.389786 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-82a4475d-c28b-4518-a7d1-3853a19a84e5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:47.391054 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-82a4475d-c28b-4518-a7d1-3853a19a84e5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.233299 May 25 15:07:47.391610 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 474/961] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:07:47 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:07:47.493137 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f3238e55-b50b-4cea-9c52-6146f547ef70 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:47.493935 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f3238e55-b50b-4cea-9c52-6146f547ef70 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:47.502036 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f3238e55-b50b-4cea-9c52-6146f547ef70 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:47.502701 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f3238e55-b50b-4cea-9c52-6146f547ef70 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:47.503977 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f3238e55-b50b-4cea-9c52-6146f547ef70 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:47.504478 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f3238e55-b50b-4cea-9c52-6146f547ef70 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:47.696676 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f3238e55-b50b-4cea-9c52-6146f547ef70 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:47.705888 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f3238e55-b50b-4cea-9c52-6146f547ef70 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1554 microversion: 2.1 time: 0.217309 May 25 15:07:47.706558 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 488/962] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:07:47 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1554 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:48.352085 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:07:48.352680 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Wed May 25 15:07:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:07:48.409357 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-83cf76e9-3b78-4214-a8d4-f63ed7a66c40 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:48.410469 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-83cf76e9-3b78-4214-a8d4-f63ed7a66c40 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:48.418137 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-83cf76e9-3b78-4214-a8d4-f63ed7a66c40 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:48.418843 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-83cf76e9-3b78-4214-a8d4-f63ed7a66c40 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:48.419788 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-83cf76e9-3b78-4214-a8d4-f63ed7a66c40 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:48.420370 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-83cf76e9-3b78-4214-a8d4-f63ed7a66c40 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:48.655002 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-83cf76e9-3b78-4214-a8d4-f63ed7a66c40 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:48.665837 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-83cf76e9-3b78-4214-a8d4-f63ed7a66c40 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:48.667761 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-83cf76e9-3b78-4214-a8d4-f63ed7a66c40 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:48.669033 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-83cf76e9-3b78-4214-a8d4-f63ed7a66c40 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.264135 May 25 15:07:48.679716 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 475/963] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:07:48 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:07:48.724889 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-409410bc-63a0-4437-a1f3-f1453bb17842 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:48.725525 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-409410bc-63a0-4437-a1f3-f1453bb17842 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:48.732203 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-409410bc-63a0-4437-a1f3-f1453bb17842 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:48.732651 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-409410bc-63a0-4437-a1f3-f1453bb17842 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:48.733421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-409410bc-63a0-4437-a1f3-f1453bb17842 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:48.733917 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-409410bc-63a0-4437-a1f3-f1453bb17842 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:48.963984 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-409410bc-63a0-4437-a1f3-f1453bb17842 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f892dfa98adb40198ce1296134d1263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9e55701e7c4fe180a21d1934298240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:48.973465 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-409410bc-63a0-4437-a1f3-f1453bb17842 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 200 len: 1554 microversion: 2.1 time: 0.252589 May 25 15:07:48.974431 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 489/964] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:07:48 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 1554 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:49.207250 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-f89fd290-9c69-4fc1-8cf2-94334a1253fd req-7fa9b10f-aa02-4cb8-8266-fd5ca6bd7548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aef5cf9-818a-4b1b-8305-258790e3845d", "name": "network-vif-deleted", "tag": "14bd1814-6415-4936-8dc1-ab3f7060d8b1"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:07:49.216059 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-f89fd290-9c69-4fc1-8cf2-94334a1253fd req-7fa9b10f-aa02-4cb8-8266-fd5ca6bd7548 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:49.216580 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-f89fd290-9c69-4fc1-8cf2-94334a1253fd req-7fa9b10f-aa02-4cb8-8266-fd5ca6bd7548 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:49.228724 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-f89fd290-9c69-4fc1-8cf2-94334a1253fd req-7fa9b10f-aa02-4cb8-8266-fd5ca6bd7548 service nova] Creating event network-vif-deleted:14bd1814-6415-4936-8dc1-ab3f7060d8b1 for instance 5aef5cf9-818a-4b1b-8305-258790e3845d on hv-cinder-80382 May 25 15:07:49.234434 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-f89fd290-9c69-4fc1-8cf2-94334a1253fd req-7fa9b10f-aa02-4cb8-8266-fd5ca6bd7548 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030692 May 25 15:07:49.235453 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 476/965] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:07:49.687493 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d888a241-8791-41b9-9d1e-bb3f41d38922 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:49.688198 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d888a241-8791-41b9-9d1e-bb3f41d38922 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:49.696182 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d888a241-8791-41b9-9d1e-bb3f41d38922 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:49.696795 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d888a241-8791-41b9-9d1e-bb3f41d38922 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:49.697683 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d888a241-8791-41b9-9d1e-bb3f41d38922 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:49.698256 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d888a241-8791-41b9-9d1e-bb3f41d38922 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:49.720482 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:49.963467 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d888a241-8791-41b9-9d1e-bb3f41d38922 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:49.980965 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d888a241-8791-41b9-9d1e-bb3f41d38922 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:49.991354 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d888a241-8791-41b9-9d1e-bb3f41d38922 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:49.991733 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2d9cc569-de85-4f11-82b9-41053038522a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:49.993172 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2d9cc569-de85-4f11-82b9-41053038522a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] [instance: 5aef5cf9-818a-4b1b-8305-258790e3845d] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:49.994447 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d888a241-8791-41b9-9d1e-bb3f41d38922 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.307975 May 25 15:07:49.997854 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 490/966] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:07:49 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:07:50.001594 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2d9cc569-de85-4f11-82b9-41053038522a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:50.002359 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2d9cc569-de85-4f11-82b9-41053038522a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:50.003360 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2d9cc569-de85-4f11-82b9-41053038522a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:50.003978 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2d9cc569-de85-4f11-82b9-41053038522a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:50.023079 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-2d9cc569-de85-4f11-82b9-41053038522a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] HTTP exception thrown: Instance 5aef5cf9-818a-4b1b-8305-258790e3845d could not be found. May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2d9cc569-de85-4f11-82b9-41053038522a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Request method failure captured: May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d HTTP/1.1 May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkWbjydlJ6PvXFwoU4VLfpU7sNK6NYXuud5qAqwvV2G451TWh9lX4YBjH6fJ31Br92ERnUMz5GwnPN0uQyytJQPYMzwliaRuQbKmxZMJhkEcsky3h6rnEvUtq5Mqti5OnSgTsgYAOVB1uOtAZCRUZh6so6u7RzaN7nhIwJ4KH4QB4Pc May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 5e9e55701e7c4fe180a21d1934298240 May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-TestMinimumBasicScenario-1942380429 May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:07:50.025053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:07:50.026726 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5e9e55701e7c4fe180a21d1934298240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5e9e55701e7c4fe180a21d1934298240"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5e9e55701e7c4fe180a21d1934298240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5e9e55701e7c4fe180a21d1934298240"}]}] May 25 15:07:50.026726 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-TestMinimumBasicScenario-1942380429 May 25 15:07:50.026726 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 5e9e55701e7c4fe180a21d1934298240 May 25 15:07:50.026726 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1942380429 May 25 15:07:50.026726 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-TestMinimumBasicScenario-1942380429-project May 25 15:07:50.026726 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:07:50.026726 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:07:50.026726 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: f892dfa98adb40198ce1296134d1263c May 25 15:07:50.026726 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-TestMinimumBasicScenario-1942380429-project May 25 15:07:50.026726 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:07:50.026726 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance 5aef5cf9-818a-4b1b-8305-258790e3845d could not be found. May 25 15:07:50.026726 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': '5aef5cf9-818a-4b1b-8305-258790e3845d'} May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aef5cf9-818a-4b1b-8305-258790e3845d could not be found. May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:07:50.027521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:07:50.028806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:07:50.028806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:07:50.028806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:07:50.028806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:07:50.028806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:07:50.028806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:07:50.028806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:07:50.028806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aef5cf9-818a-4b1b-8305-258790e3845d could not be found. May 25 15:07:50.028806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:07:50.028806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:07:50.028806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:07:50.028806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:50.028806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:07:50.028806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:07:50.028806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:07:50.028806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:07:50.028806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aef5cf9-818a-4b1b-8305-258790e3845d could not be found. May 25 15:07:50.028806 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:07:50.032846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2d9cc569-de85-4f11-82b9-41053038522a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Returning 404 to user: Instance 5aef5cf9-818a-4b1b-8305-258790e3845d could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:07:50.034170 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2d9cc569-de85-4f11-82b9-41053038522a tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d" status: 404 len: 111 microversion: 2.1 time: 0.046385 May 25 15:07:50.035265 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 477/967] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:07:49 2022] GET /compute/v2.1/servers/5aef5cf9-818a-4b1b-8305-258790e3845d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:07:50.043700 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-cebcbba0-1156-46bd-a92d-4d9c2de442d0 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] Calling method '.version_select at 0x7fb1e40f8280>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:50.067048 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-cebcbba0-1156-46bd-a92d-4d9c2de442d0 tempest-TestMinimumBasicScenario-1942380429 tempest-TestMinimumBasicScenario-1942380429-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1061173293" status: 202 len: 0 microversion: 2.1 time: 0.027145 May 25 15:07:50.067635 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 491/968] 10.222.0.78 () {58 vars in 1271 bytes} [Wed May 25 15:07:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1061173293 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:07:51.018420 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-39304012-5aa1-46ab-afdc-35ea31dbefd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:51.019059 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-39304012-5aa1-46ab-afdc-35ea31dbefd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:51.027844 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-39304012-5aa1-46ab-afdc-35ea31dbefd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:51.028699 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-39304012-5aa1-46ab-afdc-35ea31dbefd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:51.031687 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-39304012-5aa1-46ab-afdc-35ea31dbefd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:51.033024 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-39304012-5aa1-46ab-afdc-35ea31dbefd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:51.360336 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-39304012-5aa1-46ab-afdc-35ea31dbefd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:51.369601 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-39304012-5aa1-46ab-afdc-35ea31dbefd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:51.371343 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-39304012-5aa1-46ab-afdc-35ea31dbefd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:51.372675 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-39304012-5aa1-46ab-afdc-35ea31dbefd8 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.359350 May 25 15:07:51.373521 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 478/969] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:07:51 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:07:52.393731 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d7a6b0c8-4586-4522-911f-711fbc1f61cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:52.394363 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d7a6b0c8-4586-4522-911f-711fbc1f61cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:52.400765 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d7a6b0c8-4586-4522-911f-711fbc1f61cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:52.401296 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d7a6b0c8-4586-4522-911f-711fbc1f61cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:52.402169 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d7a6b0c8-4586-4522-911f-711fbc1f61cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:52.402663 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d7a6b0c8-4586-4522-911f-711fbc1f61cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:52.542186 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d7a6b0c8-4586-4522-911f-711fbc1f61cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:52.550804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d7a6b0c8-4586-4522-911f-711fbc1f61cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:52.552298 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d7a6b0c8-4586-4522-911f-711fbc1f61cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:52.553481 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d7a6b0c8-4586-4522-911f-711fbc1f61cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.164826 May 25 15:07:52.554042 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 492/970] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:07:52 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:07:53.572652 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-719b8d10-10b2-45d5-9bb3-24ee44bd1154 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:53.574384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-719b8d10-10b2-45d5-9bb3-24ee44bd1154 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:53.583416 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-719b8d10-10b2-45d5-9bb3-24ee44bd1154 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:53.583897 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-719b8d10-10b2-45d5-9bb3-24ee44bd1154 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:53.584688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-719b8d10-10b2-45d5-9bb3-24ee44bd1154 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:53.585180 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-719b8d10-10b2-45d5-9bb3-24ee44bd1154 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:53.777961 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-719b8d10-10b2-45d5-9bb3-24ee44bd1154 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:53.787769 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-719b8d10-10b2-45d5-9bb3-24ee44bd1154 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:53.789754 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-719b8d10-10b2-45d5-9bb3-24ee44bd1154 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:53.791033 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-719b8d10-10b2-45d5-9bb3-24ee44bd1154 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.222373 May 25 15:07:53.791918 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 479/971] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:07:53 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:07:54.812564 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-c3503a5b-5f5a-4ef9-8703-a6bdbcf79ca5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:54.813302 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-c3503a5b-5f5a-4ef9-8703-a6bdbcf79ca5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:54.820965 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c3503a5b-5f5a-4ef9-8703-a6bdbcf79ca5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:54.821482 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c3503a5b-5f5a-4ef9-8703-a6bdbcf79ca5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:54.822550 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c3503a5b-5f5a-4ef9-8703-a6bdbcf79ca5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:54.823042 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c3503a5b-5f5a-4ef9-8703-a6bdbcf79ca5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:55.002087 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-c3503a5b-5f5a-4ef9-8703-a6bdbcf79ca5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:55.012177 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-c3503a5b-5f5a-4ef9-8703-a6bdbcf79ca5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:55.013783 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-c3503a5b-5f5a-4ef9-8703-a6bdbcf79ca5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:55.015807 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-c3503a5b-5f5a-4ef9-8703-a6bdbcf79ca5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.208536 May 25 15:07:55.016487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 493/972] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:07:54 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:07:56.370726 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-97ed76c5-9223-4aa9-8659-8253ec94aa67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:56.371593 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-97ed76c5-9223-4aa9-8659-8253ec94aa67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:56.382192 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-97ed76c5-9223-4aa9-8659-8253ec94aa67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:56.382739 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-97ed76c5-9223-4aa9-8659-8253ec94aa67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:56.383600 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-97ed76c5-9223-4aa9-8659-8253ec94aa67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:56.384115 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-97ed76c5-9223-4aa9-8659-8253ec94aa67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:56.537721 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-97ed76c5-9223-4aa9-8659-8253ec94aa67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:56.546114 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-97ed76c5-9223-4aa9-8659-8253ec94aa67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:56.547626 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-97ed76c5-9223-4aa9-8659-8253ec94aa67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:56.548836 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-97ed76c5-9223-4aa9-8659-8253ec94aa67 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.512840 May 25 15:07:56.549393 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 480/973] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:07:56 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:07:57.568080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2aa7b321-fcf4-4803-b482-00c8d782ab76 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:57.568873 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2aa7b321-fcf4-4803-b482-00c8d782ab76 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:57.572899 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:57.579187 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2aa7b321-fcf4-4803-b482-00c8d782ab76 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:57.579696 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2aa7b321-fcf4-4803-b482-00c8d782ab76 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:57.580599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2aa7b321-fcf4-4803-b482-00c8d782ab76 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:57.581048 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2aa7b321-fcf4-4803-b482-00c8d782ab76 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:57.820501 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2aa7b321-fcf4-4803-b482-00c8d782ab76 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:57.831812 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2aa7b321-fcf4-4803-b482-00c8d782ab76 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:57.833759 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2aa7b321-fcf4-4803-b482-00c8d782ab76 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:57.835100 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2aa7b321-fcf4-4803-b482-00c8d782ab76 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.271922 May 25 15:07:57.835801 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 494/974] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:07:57 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:07:58.854489 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-f84f30e5-4b89-4283-a52d-5554d053bc7a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:58.855854 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-f84f30e5-4b89-4283-a52d-5554d053bc7a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:58.858473 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:58.863967 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f84f30e5-4b89-4283-a52d-5554d053bc7a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:58.864432 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f84f30e5-4b89-4283-a52d-5554d053bc7a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:58.865211 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f84f30e5-4b89-4283-a52d-5554d053bc7a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:58.865643 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f84f30e5-4b89-4283-a52d-5554d053bc7a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:59.040889 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-f84f30e5-4b89-4283-a52d-5554d053bc7a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:59.050644 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-f84f30e5-4b89-4283-a52d-5554d053bc7a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:59.052312 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-f84f30e5-4b89-4283-a52d-5554d053bc7a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:59.053621 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-f84f30e5-4b89-4283-a52d-5554d053bc7a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.202948 May 25 15:07:59.054272 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 481/975] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:07:58 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:00.082177 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-595ae6bf-7ef9-4028-9c69-ef39c4fb2369 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:00.082807 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-595ae6bf-7ef9-4028-9c69-ef39c4fb2369 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:00.089883 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-595ae6bf-7ef9-4028-9c69-ef39c4fb2369 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:00.090461 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-595ae6bf-7ef9-4028-9c69-ef39c4fb2369 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:00.091261 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-595ae6bf-7ef9-4028-9c69-ef39c4fb2369 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:00.091708 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-595ae6bf-7ef9-4028-9c69-ef39c4fb2369 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:00.235862 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-595ae6bf-7ef9-4028-9c69-ef39c4fb2369 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:00.244381 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-595ae6bf-7ef9-4028-9c69-ef39c4fb2369 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:00.245889 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-595ae6bf-7ef9-4028-9c69-ef39c4fb2369 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:00.247322 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-595ae6bf-7ef9-4028-9c69-ef39c4fb2369 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.170430 May 25 15:08:00.248415 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 495/976] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:00 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:01.267823 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-e33f10d5-32fc-490e-9f49-c5d583396567 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:01.268520 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-e33f10d5-32fc-490e-9f49-c5d583396567 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:01.275168 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e33f10d5-32fc-490e-9f49-c5d583396567 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:01.275615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e33f10d5-32fc-490e-9f49-c5d583396567 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:01.276396 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e33f10d5-32fc-490e-9f49-c5d583396567 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:01.276831 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e33f10d5-32fc-490e-9f49-c5d583396567 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:01.418550 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-e33f10d5-32fc-490e-9f49-c5d583396567 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:01.428646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-e33f10d5-32fc-490e-9f49-c5d583396567 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:01.430255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-e33f10d5-32fc-490e-9f49-c5d583396567 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:01.431425 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-e33f10d5-32fc-490e-9f49-c5d583396567 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.168157 May 25 15:08:01.431980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 482/977] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:01 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:02.451296 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ab30eb0c-f065-448f-9081-48d9b8491117 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:02.452043 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ab30eb0c-f065-448f-9081-48d9b8491117 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:02.460248 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ab30eb0c-f065-448f-9081-48d9b8491117 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:02.460699 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ab30eb0c-f065-448f-9081-48d9b8491117 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:02.461485 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ab30eb0c-f065-448f-9081-48d9b8491117 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:02.462090 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ab30eb0c-f065-448f-9081-48d9b8491117 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:02.600218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ab30eb0c-f065-448f-9081-48d9b8491117 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:02.609081 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ab30eb0c-f065-448f-9081-48d9b8491117 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:02.611488 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ab30eb0c-f065-448f-9081-48d9b8491117 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:02.612831 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ab30eb0c-f065-448f-9081-48d9b8491117 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.165833 May 25 15:08:02.613459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 496/978] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:02 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:03.631654 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-f91f9cb7-fef2-478b-8b98-75d57e36ecb1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:03.632355 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-f91f9cb7-fef2-478b-8b98-75d57e36ecb1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:03.640773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f91f9cb7-fef2-478b-8b98-75d57e36ecb1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:03.641233 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f91f9cb7-fef2-478b-8b98-75d57e36ecb1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:03.642127 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f91f9cb7-fef2-478b-8b98-75d57e36ecb1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:03.642655 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f91f9cb7-fef2-478b-8b98-75d57e36ecb1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:03.794368 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-f91f9cb7-fef2-478b-8b98-75d57e36ecb1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:03.803813 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-f91f9cb7-fef2-478b-8b98-75d57e36ecb1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:03.804873 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-f91f9cb7-fef2-478b-8b98-75d57e36ecb1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:03.806093 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-f91f9cb7-fef2-478b-8b98-75d57e36ecb1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.178715 May 25 15:08:03.806662 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 483/979] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:03 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:08:04.826867 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4b5bc12f-d53f-4e54-ac14-f83dc08c8595 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:04.827568 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4b5bc12f-d53f-4e54-ac14-f83dc08c8595 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:04.834671 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4b5bc12f-d53f-4e54-ac14-f83dc08c8595 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:04.835155 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4b5bc12f-d53f-4e54-ac14-f83dc08c8595 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:04.836039 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4b5bc12f-d53f-4e54-ac14-f83dc08c8595 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:04.836574 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4b5bc12f-d53f-4e54-ac14-f83dc08c8595 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:04.971944 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4b5bc12f-d53f-4e54-ac14-f83dc08c8595 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:04.980402 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4b5bc12f-d53f-4e54-ac14-f83dc08c8595 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:04.982190 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4b5bc12f-d53f-4e54-ac14-f83dc08c8595 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:04.983620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4b5bc12f-d53f-4e54-ac14-f83dc08c8595 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.161337 May 25 15:08:04.984848 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 497/980] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:04 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:06.004156 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7ab1b029-51e1-4731-9692-dbbf1d8bd9a7 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:06.004748 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7ab1b029-51e1-4731-9692-dbbf1d8bd9a7 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:06.011548 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7ab1b029-51e1-4731-9692-dbbf1d8bd9a7 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:06.011985 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7ab1b029-51e1-4731-9692-dbbf1d8bd9a7 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:06.012739 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7ab1b029-51e1-4731-9692-dbbf1d8bd9a7 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:06.013167 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7ab1b029-51e1-4731-9692-dbbf1d8bd9a7 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:06.140765 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7ab1b029-51e1-4731-9692-dbbf1d8bd9a7 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:06.148731 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7ab1b029-51e1-4731-9692-dbbf1d8bd9a7 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:06.150253 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7ab1b029-51e1-4731-9692-dbbf1d8bd9a7 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:06.151392 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7ab1b029-51e1-4731-9692-dbbf1d8bd9a7 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1743 microversion: 2.20 time: 0.151134 May 25 15:08:06.151938 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 484/981] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:05 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:07.170113 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-5195dcf8-28cf-41b7-a736-c64a368c5062 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:07.170703 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-5195dcf8-28cf-41b7-a736-c64a368c5062 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:07.178003 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5195dcf8-28cf-41b7-a736-c64a368c5062 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:07.178487 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5195dcf8-28cf-41b7-a736-c64a368c5062 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:07.179273 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5195dcf8-28cf-41b7-a736-c64a368c5062 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:07.179803 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5195dcf8-28cf-41b7-a736-c64a368c5062 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:07.317521 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5195dcf8-28cf-41b7-a736-c64a368c5062 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:07.325513 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5195dcf8-28cf-41b7-a736-c64a368c5062 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:07.327040 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5195dcf8-28cf-41b7-a736-c64a368c5062 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:07.328745 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-5195dcf8-28cf-41b7-a736-c64a368c5062 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1743 microversion: 2.20 time: 0.162728 May 25 15:08:07.329302 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 498/982] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:07 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:08.353240 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-19ecde0e-2370-4153-b79e-308a8492ab1d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:08.354206 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-19ecde0e-2370-4153-b79e-308a8492ab1d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:08.364017 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-19ecde0e-2370-4153-b79e-308a8492ab1d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:08.364903 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-19ecde0e-2370-4153-b79e-308a8492ab1d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:08.366178 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-19ecde0e-2370-4153-b79e-308a8492ab1d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:08.366959 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-19ecde0e-2370-4153-b79e-308a8492ab1d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:08.537003 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-19ecde0e-2370-4153-b79e-308a8492ab1d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:08.547520 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-19ecde0e-2370-4153-b79e-308a8492ab1d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:08.549333 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-19ecde0e-2370-4153-b79e-308a8492ab1d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:08.550574 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-19ecde0e-2370-4153-b79e-308a8492ab1d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1738 microversion: 2.20 time: 0.208480 May 25 15:08:08.551602 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 485/983] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:08 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:09.570259 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-28fe5634-597f-4489-b7ce-83e2fee3f481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:09.571154 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-28fe5634-597f-4489-b7ce-83e2fee3f481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:09.577187 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-28fe5634-597f-4489-b7ce-83e2fee3f481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:09.577670 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-28fe5634-597f-4489-b7ce-83e2fee3f481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:09.578534 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-28fe5634-597f-4489-b7ce-83e2fee3f481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:09.578971 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-28fe5634-597f-4489-b7ce-83e2fee3f481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:09.727881 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-28fe5634-597f-4489-b7ce-83e2fee3f481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:09.736166 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-28fe5634-597f-4489-b7ce-83e2fee3f481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:09.737692 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-28fe5634-597f-4489-b7ce-83e2fee3f481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:09.738931 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-28fe5634-597f-4489-b7ce-83e2fee3f481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1738 microversion: 2.20 time: 0.173181 May 25 15:08:09.739981 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 499/984] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:09 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:10.200188 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-9b36071e-ea8a-446f-9aec-7a2806e553f3 req-0552df1f-4a5e-407a-9d2e-f37792f751af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4202b1b8-016d-4d26-ad4a-a2d3f6b58c65", "name": "network-vif-plugged", "status": "completed", "tag": "e6550da8-2d3f-49e5-ba79-3b3fb3daaf6a"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:08:10.210206 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-9b36071e-ea8a-446f-9aec-7a2806e553f3 req-0552df1f-4a5e-407a-9d2e-f37792f751af service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:10.210773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-9b36071e-ea8a-446f-9aec-7a2806e553f3 req-0552df1f-4a5e-407a-9d2e-f37792f751af service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:10.228664 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-9b36071e-ea8a-446f-9aec-7a2806e553f3 req-0552df1f-4a5e-407a-9d2e-f37792f751af service nova] Creating event network-vif-plugged:e6550da8-2d3f-49e5-ba79-3b3fb3daaf6a for instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 on hv-cinder-80382 May 25 15:08:10.235654 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-9b36071e-ea8a-446f-9aec-7a2806e553f3 req-0552df1f-4a5e-407a-9d2e-f37792f751af service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202387 May 25 15:08:10.236404 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 486/985] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:08:10.757776 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-18141187-6715-42c4-8292-f1ccf78ef0c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:10.758759 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-18141187-6715-42c4-8292-f1ccf78ef0c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:10.766803 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-18141187-6715-42c4-8292-f1ccf78ef0c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:10.767789 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-18141187-6715-42c4-8292-f1ccf78ef0c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:10.768254 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-18141187-6715-42c4-8292-f1ccf78ef0c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:10.768914 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-18141187-6715-42c4-8292-f1ccf78ef0c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:10.929481 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-18141187-6715-42c4-8292-f1ccf78ef0c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:10.938512 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-18141187-6715-42c4-8292-f1ccf78ef0c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:10.940037 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-18141187-6715-42c4-8292-f1ccf78ef0c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:10.941233 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-18141187-6715-42c4-8292-f1ccf78ef0c5 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1738 microversion: 2.20 time: 0.187816 May 25 15:08:10.941788 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 500/986] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:10 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:11.961297 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b4bda095-751e-4f0b-9bad-d0f2294aed44 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:11.962355 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b4bda095-751e-4f0b-9bad-d0f2294aed44 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:11.970448 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b4bda095-751e-4f0b-9bad-d0f2294aed44 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:11.971261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b4bda095-751e-4f0b-9bad-d0f2294aed44 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:11.972474 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b4bda095-751e-4f0b-9bad-d0f2294aed44 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:11.973126 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b4bda095-751e-4f0b-9bad-d0f2294aed44 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:12.161305 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b4bda095-751e-4f0b-9bad-d0f2294aed44 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:12.169345 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b4bda095-751e-4f0b-9bad-d0f2294aed44 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:12.170891 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b4bda095-751e-4f0b-9bad-d0f2294aed44 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:12.172097 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b4bda095-751e-4f0b-9bad-d0f2294aed44 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1738 microversion: 2.20 time: 0.215940 May 25 15:08:12.181543 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 487/987] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:11 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:13.192326 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8ffa7b40-f659-4704-b21a-6dc9c3c5f73c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:13.193585 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8ffa7b40-f659-4704-b21a-6dc9c3c5f73c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:13.200887 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8ffa7b40-f659-4704-b21a-6dc9c3c5f73c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:13.201345 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8ffa7b40-f659-4704-b21a-6dc9c3c5f73c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:13.202170 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8ffa7b40-f659-4704-b21a-6dc9c3c5f73c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:13.203127 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8ffa7b40-f659-4704-b21a-6dc9c3c5f73c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:13.367272 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8ffa7b40-f659-4704-b21a-6dc9c3c5f73c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:13.376607 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8ffa7b40-f659-4704-b21a-6dc9c3c5f73c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:13.378354 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8ffa7b40-f659-4704-b21a-6dc9c3c5f73c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:13.379624 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8ffa7b40-f659-4704-b21a-6dc9c3c5f73c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1738 microversion: 2.20 time: 0.192515 May 25 15:08:13.380201 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 501/988] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:13 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:14.399679 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-8086fdca-d7fa-45ea-b29e-d5c8d7e232b9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:14.400542 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-8086fdca-d7fa-45ea-b29e-d5c8d7e232b9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:14.407910 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8086fdca-d7fa-45ea-b29e-d5c8d7e232b9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:14.408425 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8086fdca-d7fa-45ea-b29e-d5c8d7e232b9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:14.409623 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8086fdca-d7fa-45ea-b29e-d5c8d7e232b9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:14.410091 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-8086fdca-d7fa-45ea-b29e-d5c8d7e232b9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:14.588232 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-8086fdca-d7fa-45ea-b29e-d5c8d7e232b9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:14.597773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-8086fdca-d7fa-45ea-b29e-d5c8d7e232b9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:14.599327 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-8086fdca-d7fa-45ea-b29e-d5c8d7e232b9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:14.601396 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-8086fdca-d7fa-45ea-b29e-d5c8d7e232b9 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1738 microversion: 2.20 time: 0.205791 May 25 15:08:14.602480 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 488/989] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:14 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:15.622346 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-cff9b235-4eae-498b-b6c5-f2720fea50fb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:15.623239 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-cff9b235-4eae-498b-b6c5-f2720fea50fb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:15.630560 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cff9b235-4eae-498b-b6c5-f2720fea50fb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:15.631018 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cff9b235-4eae-498b-b6c5-f2720fea50fb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:15.631804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cff9b235-4eae-498b-b6c5-f2720fea50fb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:15.632244 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-cff9b235-4eae-498b-b6c5-f2720fea50fb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:15.810811 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-cff9b235-4eae-498b-b6c5-f2720fea50fb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:15.821884 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-cff9b235-4eae-498b-b6c5-f2720fea50fb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:15.823450 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-cff9b235-4eae-498b-b6c5-f2720fea50fb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:15.824673 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-cff9b235-4eae-498b-b6c5-f2720fea50fb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1738 microversion: 2.20 time: 0.208384 May 25 15:08:15.825990 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 502/990] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:15 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:16.845805 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-3cb5aa04-c7a3-4a08-a22d-29926019ef71 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:16.846693 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-3cb5aa04-c7a3-4a08-a22d-29926019ef71 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:16.853290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3cb5aa04-c7a3-4a08-a22d-29926019ef71 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:16.853735 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3cb5aa04-c7a3-4a08-a22d-29926019ef71 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:16.854667 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3cb5aa04-c7a3-4a08-a22d-29926019ef71 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:16.855101 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3cb5aa04-c7a3-4a08-a22d-29926019ef71 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:16.858326 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:17.013481 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3cb5aa04-c7a3-4a08-a22d-29926019ef71 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:17.022842 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3cb5aa04-c7a3-4a08-a22d-29926019ef71 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:17.024350 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3cb5aa04-c7a3-4a08-a22d-29926019ef71 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:17.025515 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-3cb5aa04-c7a3-4a08-a22d-29926019ef71 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1738 microversion: 2.20 time: 0.184454 May 25 15:08:17.026102 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 489/991] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:16 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:17.395536 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f04dbf9a-80c2-4f1d-b90a-6e4e67bbcabd tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:08:17.396087 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f04dbf9a-80c2-4f1d-b90a-6e4e67bbcabd tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:17.402607 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f04dbf9a-80c2-4f1d-b90a-6e4e67bbcabd tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:17.403058 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f04dbf9a-80c2-4f1d-b90a-6e4e67bbcabd tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:17.403834 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f04dbf9a-80c2-4f1d-b90a-6e4e67bbcabd tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:17.404276 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f04dbf9a-80c2-4f1d-b90a-6e4e67bbcabd tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:17.426156 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.objects.instance [None req-f04dbf9a-80c2-4f1d-b90a-6e4e67bbcabd tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lazy-loading 'flavor' on Instance uuid dc3433ac-9290-4294-83ad-1fa030982ca5 {{(pid=124523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:08:17.498165 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f04dbf9a-80c2-4f1d-b90a-6e4e67bbcabd tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "POST /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5/action" status: 202 len: 0 microversion: 2.1 time: 0.106442 May 25 15:08:17.498750 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 503/992] 10.222.0.78 () {60 vars in 1277 bytes} [Wed May 25 15:08:17 2022] POST /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:08:17.507536 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2609a1ac-95f6-4da9-98fc-0e0dac640d41 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:17.508142 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2609a1ac-95f6-4da9-98fc-0e0dac640d41 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:17.514586 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2609a1ac-95f6-4da9-98fc-0e0dac640d41 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:17.515654 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2609a1ac-95f6-4da9-98fc-0e0dac640d41 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:17.516578 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2609a1ac-95f6-4da9-98fc-0e0dac640d41 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:17.517012 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2609a1ac-95f6-4da9-98fc-0e0dac640d41 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:17.648486 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-2609a1ac-95f6-4da9-98fc-0e0dac640d41 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:17.656894 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2609a1ac-95f6-4da9-98fc-0e0dac640d41 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.153130 May 25 15:08:17.657462 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 490/993] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:17 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:18.044701 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0fd8b2dc-b9d7-4174-b2ad-ad8db5348e46 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:18.045407 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-0fd8b2dc-b9d7-4174-b2ad-ad8db5348e46 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:18.051832 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0fd8b2dc-b9d7-4174-b2ad-ad8db5348e46 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:18.052282 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0fd8b2dc-b9d7-4174-b2ad-ad8db5348e46 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:18.053052 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0fd8b2dc-b9d7-4174-b2ad-ad8db5348e46 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:18.053490 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0fd8b2dc-b9d7-4174-b2ad-ad8db5348e46 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:18.265759 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-0fd8b2dc-b9d7-4174-b2ad-ad8db5348e46 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:18.273927 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-0fd8b2dc-b9d7-4174-b2ad-ad8db5348e46 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:18.275472 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-0fd8b2dc-b9d7-4174-b2ad-ad8db5348e46 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:18.276642 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-0fd8b2dc-b9d7-4174-b2ad-ad8db5348e46 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1720 microversion: 2.20 time: 0.236283 May 25 15:08:18.277194 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 504/994] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:18 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1720 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:18.674615 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-09e16e1f-a184-49d1-ae48-2fcde8a97a33 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:18.675293 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-09e16e1f-a184-49d1-ae48-2fcde8a97a33 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:18.681795 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-09e16e1f-a184-49d1-ae48-2fcde8a97a33 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:18.682282 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-09e16e1f-a184-49d1-ae48-2fcde8a97a33 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:18.683053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-09e16e1f-a184-49d1-ae48-2fcde8a97a33 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:18.683489 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-09e16e1f-a184-49d1-ae48-2fcde8a97a33 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:18.815225 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-09e16e1f-a184-49d1-ae48-2fcde8a97a33 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:18.822994 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-09e16e1f-a184-49d1-ae48-2fcde8a97a33 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.152794 May 25 15:08:18.823568 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 491/995] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:18 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:19.295147 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-5fcc4927-e626-4727-bab3-d9ec2b7443be tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:19.295731 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-5fcc4927-e626-4727-bab3-d9ec2b7443be tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:19.302816 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5fcc4927-e626-4727-bab3-d9ec2b7443be tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:19.303256 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5fcc4927-e626-4727-bab3-d9ec2b7443be tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:19.304012 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5fcc4927-e626-4727-bab3-d9ec2b7443be tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:19.304441 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5fcc4927-e626-4727-bab3-d9ec2b7443be tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:19.442329 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5fcc4927-e626-4727-bab3-d9ec2b7443be tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:19.453636 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5fcc4927-e626-4727-bab3-d9ec2b7443be tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:19.455317 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5fcc4927-e626-4727-bab3-d9ec2b7443be tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:19.456535 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-5fcc4927-e626-4727-bab3-d9ec2b7443be tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1720 microversion: 2.20 time: 0.165361 May 25 15:08:19.457098 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 505/996] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:19 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:19.840511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d5609fe2-d9a2-413e-9697-45ad90d71f33 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:19.841127 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d5609fe2-d9a2-413e-9697-45ad90d71f33 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:19.848051 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d5609fe2-d9a2-413e-9697-45ad90d71f33 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:19.848491 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d5609fe2-d9a2-413e-9697-45ad90d71f33 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:19.849278 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d5609fe2-d9a2-413e-9697-45ad90d71f33 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:19.849709 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d5609fe2-d9a2-413e-9697-45ad90d71f33 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:19.985849 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d5609fe2-d9a2-413e-9697-45ad90d71f33 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:19.993541 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d5609fe2-d9a2-413e-9697-45ad90d71f33 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.157018 May 25 15:08:19.994168 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 492/997] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:19 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:20.476709 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-76d4fedd-6243-40ce-af76-46654887e240 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:20.477448 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-76d4fedd-6243-40ce-af76-46654887e240 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:20.484539 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-76d4fedd-6243-40ce-af76-46654887e240 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:20.485043 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-76d4fedd-6243-40ce-af76-46654887e240 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:20.485832 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-76d4fedd-6243-40ce-af76-46654887e240 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:20.486320 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-76d4fedd-6243-40ce-af76-46654887e240 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:20.489199 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:20.623076 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-76d4fedd-6243-40ce-af76-46654887e240 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:20.632043 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-76d4fedd-6243-40ce-af76-46654887e240 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:20.633562 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-76d4fedd-6243-40ce-af76-46654887e240 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:20.634873 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-76d4fedd-6243-40ce-af76-46654887e240 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1720 microversion: 2.20 time: 0.163678 May 25 15:08:20.635432 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 506/998] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:20 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:21.012742 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-010b2bd4-f53e-4d5c-9841-b73de9cf60fa tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:21.013366 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-010b2bd4-f53e-4d5c-9841-b73de9cf60fa tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:21.021763 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-010b2bd4-f53e-4d5c-9841-b73de9cf60fa tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:21.022257 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-010b2bd4-f53e-4d5c-9841-b73de9cf60fa tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:21.023048 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-010b2bd4-f53e-4d5c-9841-b73de9cf60fa tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:21.023481 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-010b2bd4-f53e-4d5c-9841-b73de9cf60fa tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:21.167779 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-010b2bd4-f53e-4d5c-9841-b73de9cf60fa tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:21.175669 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-010b2bd4-f53e-4d5c-9841-b73de9cf60fa tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.167078 May 25 15:08:21.176247 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 493/999] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:21 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:08:21.654155 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e72a43ee-e2a9-49e6-99b5-cd5f97228592 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:21.654767 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e72a43ee-e2a9-49e6-99b5-cd5f97228592 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:21.661794 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e72a43ee-e2a9-49e6-99b5-cd5f97228592 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:21.662291 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e72a43ee-e2a9-49e6-99b5-cd5f97228592 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:21.663093 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e72a43ee-e2a9-49e6-99b5-cd5f97228592 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:21.663538 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e72a43ee-e2a9-49e6-99b5-cd5f97228592 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:21.792352 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e72a43ee-e2a9-49e6-99b5-cd5f97228592 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:21.800966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e72a43ee-e2a9-49e6-99b5-cd5f97228592 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:21.802498 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e72a43ee-e2a9-49e6-99b5-cd5f97228592 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:21.803655 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e72a43ee-e2a9-49e6-99b5-cd5f97228592 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1663 microversion: 2.20 time: 0.153496 May 25 15:08:21.804208 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 507/1000] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:21 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:21.821476 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b80a672d-8f97-4b1b-9ff3-8fb91784185d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c26855d2-51aa-4f46-b6b9-5566759ad80c"}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:08:21.822662 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b80a672d-8f97-4b1b-9ff3-8fb91784185d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:21.829167 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b80a672d-8f97-4b1b-9ff3-8fb91784185d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:21.829646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b80a672d-8f97-4b1b-9ff3-8fb91784185d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:21.830512 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b80a672d-8f97-4b1b-9ff3-8fb91784185d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:21.830948 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b80a672d-8f97-4b1b-9ff3-8fb91784185d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:22.117101 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-18d7c806-0fbf-4eda-9178-ea07e4dd4a75 req-69136f49-b6d1-4a01-a13d-340d2be45cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4202b1b8-016d-4d26-ad4a-a2d3f6b58c65", "name": "network-vif-unplugged", "status": "completed", "tag": "e6550da8-2d3f-49e5-ba79-3b3fb3daaf6a"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:08:22.126476 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-18d7c806-0fbf-4eda-9178-ea07e4dd4a75 req-69136f49-b6d1-4a01-a13d-340d2be45cd4 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:22.126927 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-18d7c806-0fbf-4eda-9178-ea07e4dd4a75 req-69136f49-b6d1-4a01-a13d-340d2be45cd4 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:22.142220 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.compute.server_external_events [req-18d7c806-0fbf-4eda-9178-ea07e4dd4a75 req-69136f49-b6d1-4a01-a13d-340d2be45cd4 service nova] Unable to find a host for instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65. Dropping event network-vif-unplugged {{(pid=124523) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 25 15:08:22.143733 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-18d7c806-0fbf-4eda-9178-ea07e4dd4a75 req-69136f49-b6d1-4a01-a13d-340d2be45cd4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030596 May 25 15:08:22.144789 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 508/1001] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 25 15:08:22.150278 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b80a672d-8f97-4b1b-9ff3-8fb91784185d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "POST /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.332798 May 25 15:08:22.150952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 494/1002] 10.222.0.78 () {62 vars in 1363 bytes} [Wed May 25 15:08:21 2022] POST /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65/os-volume_attachments => generated 188 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:08:22.193218 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-6d926c98-ecaf-44e7-84c2-171d18bf26b0 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:22.193895 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-6d926c98-ecaf-44e7-84c2-171d18bf26b0 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:22.199991 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6d926c98-ecaf-44e7-84c2-171d18bf26b0 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:22.200435 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6d926c98-ecaf-44e7-84c2-171d18bf26b0 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:22.201204 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6d926c98-ecaf-44e7-84c2-171d18bf26b0 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:22.201754 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6d926c98-ecaf-44e7-84c2-171d18bf26b0 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:22.271161 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-4463bb60-a775-4319-add0-7c83f7a9d9d6 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:22.271663 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-4463bb60-a775-4319-add0-7c83f7a9d9d6 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:22.278509 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4463bb60-a775-4319-add0-7c83f7a9d9d6 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:22.278956 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4463bb60-a775-4319-add0-7c83f7a9d9d6 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:22.279728 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4463bb60-a775-4319-add0-7c83f7a9d9d6 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:22.280160 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4463bb60-a775-4319-add0-7c83f7a9d9d6 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:22.338705 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-6d926c98-ecaf-44e7-84c2-171d18bf26b0 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:22.346323 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-6d926c98-ecaf-44e7-84c2-171d18bf26b0 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.156898 May 25 15:08:22.346889 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 509/1003] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:22 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:22.532471 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-4463bb60-a775-4319-add0-7c83f7a9d9d6 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65/os-volume_attachments/c26855d2-51aa-4f46-b6b9-5566759ad80c" status: 202 len: 0 microversion: 2.20 time: 0.265307 May 25 15:08:22.533153 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 495/1004] 10.222.0.78 () {60 vars in 1456 bytes} [Wed May 25 15:08:22 2022] DELETE /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65/os-volume_attachments/c26855d2-51aa-4f46-b6b9-5566759ad80c => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 25 15:08:22.590505 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b53ecac0-e8c0-461e-b46a-57ba5c8cb8bb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:08:22.591080 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-b53ecac0-e8c0-461e-b46a-57ba5c8cb8bb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:22.598050 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b53ecac0-e8c0-461e-b46a-57ba5c8cb8bb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:22.598506 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b53ecac0-e8c0-461e-b46a-57ba5c8cb8bb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:22.599278 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b53ecac0-e8c0-461e-b46a-57ba5c8cb8bb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:22.599711 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b53ecac0-e8c0-461e-b46a-57ba5c8cb8bb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:22.693215 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-b53ecac0-e8c0-461e-b46a-57ba5c8cb8bb tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "POST /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65/action" status: 202 len: 0 microversion: 2.20 time: 0.106447 May 25 15:08:22.693879 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 510/1005] 10.222.0.78 () {62 vars in 1318 bytes} [Wed May 25 15:08:22 2022] POST /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 15:08:22.701877 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-09b81123-1afa-4c93-ad1c-117cf598ea89 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:22.702539 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-09b81123-1afa-4c93-ad1c-117cf598ea89 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:22.708737 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-09b81123-1afa-4c93-ad1c-117cf598ea89 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:22.709260 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-09b81123-1afa-4c93-ad1c-117cf598ea89 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:22.710142 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-09b81123-1afa-4c93-ad1c-117cf598ea89 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:22.710672 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-09b81123-1afa-4c93-ad1c-117cf598ea89 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:22.848932 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-09b81123-1afa-4c93-ad1c-117cf598ea89 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:22.856907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-09b81123-1afa-4c93-ad1c-117cf598ea89 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:22.858471 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-09b81123-1afa-4c93-ad1c-117cf598ea89 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:22.859709 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-09b81123-1afa-4c93-ad1c-117cf598ea89 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1671 microversion: 2.20 time: 0.161803 May 25 15:08:22.860261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 496/1006] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:22 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:23.363451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d2a67312-2067-4df6-895c-e8a9c17cfac0 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:23.364129 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d2a67312-2067-4df6-895c-e8a9c17cfac0 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:23.370454 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d2a67312-2067-4df6-895c-e8a9c17cfac0 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:23.370899 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d2a67312-2067-4df6-895c-e8a9c17cfac0 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:23.371697 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d2a67312-2067-4df6-895c-e8a9c17cfac0 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:23.372131 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d2a67312-2067-4df6-895c-e8a9c17cfac0 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:23.515691 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d2a67312-2067-4df6-895c-e8a9c17cfac0 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:23.524025 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d2a67312-2067-4df6-895c-e8a9c17cfac0 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.164542 May 25 15:08:23.524594 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 511/1007] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:23 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:23.877640 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-9ccf3b64-b9c8-486f-8f32-a9b9790e41f3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:23.878341 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-9ccf3b64-b9c8-486f-8f32-a9b9790e41f3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:23.884952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9ccf3b64-b9c8-486f-8f32-a9b9790e41f3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:23.885471 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9ccf3b64-b9c8-486f-8f32-a9b9790e41f3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:23.886620 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9ccf3b64-b9c8-486f-8f32-a9b9790e41f3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:23.887118 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-9ccf3b64-b9c8-486f-8f32-a9b9790e41f3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:24.019737 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-9ccf3b64-b9c8-486f-8f32-a9b9790e41f3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:24.029132 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-9ccf3b64-b9c8-486f-8f32-a9b9790e41f3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:24.030128 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-9ccf3b64-b9c8-486f-8f32-a9b9790e41f3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:24.031940 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-9ccf3b64-b9c8-486f-8f32-a9b9790e41f3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1673 microversion: 2.20 time: 0.158394 May 25 15:08:24.032502 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 497/1008] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:23 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:24.541827 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-d8813a2c-32ce-484a-8ac6-2f018204c4fd tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:24.542469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-d8813a2c-32ce-484a-8ac6-2f018204c4fd tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:24.548872 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d8813a2c-32ce-484a-8ac6-2f018204c4fd tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:24.549325 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d8813a2c-32ce-484a-8ac6-2f018204c4fd tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:24.550116 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d8813a2c-32ce-484a-8ac6-2f018204c4fd tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:24.550562 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-d8813a2c-32ce-484a-8ac6-2f018204c4fd tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:24.758316 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-d8813a2c-32ce-484a-8ac6-2f018204c4fd tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:24.766303 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-d8813a2c-32ce-484a-8ac6-2f018204c4fd tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.228364 May 25 15:08:24.766866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 512/1009] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:24 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:25.050846 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-bb7587ad-f6bf-4e18-9487-2d222e7ff520 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:25.051476 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-bb7587ad-f6bf-4e18-9487-2d222e7ff520 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:25.058100 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bb7587ad-f6bf-4e18-9487-2d222e7ff520 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:25.058552 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bb7587ad-f6bf-4e18-9487-2d222e7ff520 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:25.059330 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bb7587ad-f6bf-4e18-9487-2d222e7ff520 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:25.059766 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-bb7587ad-f6bf-4e18-9487-2d222e7ff520 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:25.196983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-bb7587ad-f6bf-4e18-9487-2d222e7ff520 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:25.205507 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-bb7587ad-f6bf-4e18-9487-2d222e7ff520 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:25.207048 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-bb7587ad-f6bf-4e18-9487-2d222e7ff520 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:25.208246 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-bb7587ad-f6bf-4e18-9487-2d222e7ff520 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1729 microversion: 2.20 time: 0.161319 May 25 15:08:25.208796 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 498/1010] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:25 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:08:25.783826 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3740f388-b2a5-4af5-80ca-d2bba4030d6e tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:25.784434 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-3740f388-b2a5-4af5-80ca-d2bba4030d6e tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:25.790990 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3740f388-b2a5-4af5-80ca-d2bba4030d6e tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:25.793713 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3740f388-b2a5-4af5-80ca-d2bba4030d6e tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:25.794674 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3740f388-b2a5-4af5-80ca-d2bba4030d6e tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:25.795134 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3740f388-b2a5-4af5-80ca-d2bba4030d6e tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:25.950931 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-3740f388-b2a5-4af5-80ca-d2bba4030d6e tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:25.959721 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3740f388-b2a5-4af5-80ca-d2bba4030d6e tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.180166 May 25 15:08:25.960298 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 513/1011] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:25 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:26.226471 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d8956708-8e71-4ecf-87d4-2199cccbc166 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:26.227055 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d8956708-8e71-4ecf-87d4-2199cccbc166 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:26.233459 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d8956708-8e71-4ecf-87d4-2199cccbc166 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:26.234697 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d8956708-8e71-4ecf-87d4-2199cccbc166 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:26.235604 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d8956708-8e71-4ecf-87d4-2199cccbc166 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:26.236039 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d8956708-8e71-4ecf-87d4-2199cccbc166 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:26.383669 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d8956708-8e71-4ecf-87d4-2199cccbc166 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:26.393206 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d8956708-8e71-4ecf-87d4-2199cccbc166 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:26.394762 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d8956708-8e71-4ecf-87d4-2199cccbc166 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:26.395927 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d8956708-8e71-4ecf-87d4-2199cccbc166 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1729 microversion: 2.20 time: 0.173554 May 25 15:08:26.396486 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 499/1012] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:26 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:26.976943 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8f6d60b8-471f-4d77-82fd-273b840d0544 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:26.977951 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8f6d60b8-471f-4d77-82fd-273b840d0544 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:26.985907 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8f6d60b8-471f-4d77-82fd-273b840d0544 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:26.986405 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8f6d60b8-471f-4d77-82fd-273b840d0544 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:26.987179 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8f6d60b8-471f-4d77-82fd-273b840d0544 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:26.987621 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8f6d60b8-471f-4d77-82fd-273b840d0544 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:27.132987 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8f6d60b8-471f-4d77-82fd-273b840d0544 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:27.143282 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8f6d60b8-471f-4d77-82fd-273b840d0544 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.170336 May 25 15:08:27.143946 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 514/1013] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:26 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:27.414918 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-172a3a28-c639-4f2e-8383-9810f8b7a9aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:27.415599 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-172a3a28-c639-4f2e-8383-9810f8b7a9aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:27.422748 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-172a3a28-c639-4f2e-8383-9810f8b7a9aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:27.423197 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-172a3a28-c639-4f2e-8383-9810f8b7a9aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:27.424203 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-172a3a28-c639-4f2e-8383-9810f8b7a9aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:27.424638 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-172a3a28-c639-4f2e-8383-9810f8b7a9aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:27.444927 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:27.570791 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-172a3a28-c639-4f2e-8383-9810f8b7a9aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:27.579883 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-172a3a28-c639-4f2e-8383-9810f8b7a9aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:27.581389 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-172a3a28-c639-4f2e-8383-9810f8b7a9aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:27.582716 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-172a3a28-c639-4f2e-8383-9810f8b7a9aa tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1729 microversion: 2.20 time: 0.171922 May 25 15:08:27.583479 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 500/1014] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:27 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:28.161317 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-db8202d2-de2a-4386-88be-492aa2abe2d8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:28.161866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-db8202d2-de2a-4386-88be-492aa2abe2d8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:28.164254 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=44 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:28.170514 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-db8202d2-de2a-4386-88be-492aa2abe2d8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:28.170966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-db8202d2-de2a-4386-88be-492aa2abe2d8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:28.172299 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-db8202d2-de2a-4386-88be-492aa2abe2d8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:28.172735 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-db8202d2-de2a-4386-88be-492aa2abe2d8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:28.309526 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-db8202d2-de2a-4386-88be-492aa2abe2d8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:28.318178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-db8202d2-de2a-4386-88be-492aa2abe2d8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.160824 May 25 15:08:28.319103 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 515/1015] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:28 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:28.600809 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-4a705ac8-ef07-4d56-8255-f182f4bc450a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:28.601406 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-4a705ac8-ef07-4d56-8255-f182f4bc450a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:28.608416 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4a705ac8-ef07-4d56-8255-f182f4bc450a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:28.608985 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4a705ac8-ef07-4d56-8255-f182f4bc450a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:28.609661 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4a705ac8-ef07-4d56-8255-f182f4bc450a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:28.610151 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4a705ac8-ef07-4d56-8255-f182f4bc450a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:28.754561 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-4a705ac8-ef07-4d56-8255-f182f4bc450a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:28.763372 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-4a705ac8-ef07-4d56-8255-f182f4bc450a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:28.765591 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-4a705ac8-ef07-4d56-8255-f182f4bc450a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:28.766815 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-4a705ac8-ef07-4d56-8255-f182f4bc450a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1729 microversion: 2.20 time: 0.170050 May 25 15:08:28.767607 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 501/1016] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:28 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:29.336320 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-978f7fef-1d65-47d9-83a1-c205e46859ca tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:29.337175 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-978f7fef-1d65-47d9-83a1-c205e46859ca tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:29.345780 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-978f7fef-1d65-47d9-83a1-c205e46859ca tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:29.346363 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-978f7fef-1d65-47d9-83a1-c205e46859ca tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:29.347233 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-978f7fef-1d65-47d9-83a1-c205e46859ca tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:29.347729 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-978f7fef-1d65-47d9-83a1-c205e46859ca tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:29.518852 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-978f7fef-1d65-47d9-83a1-c205e46859ca tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:29.526695 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-978f7fef-1d65-47d9-83a1-c205e46859ca tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.194303 May 25 15:08:29.527268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 516/1017] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:29 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:29.786255 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-09093cc2-477e-40be-bd0e-20fc0c2d4111 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:29.786849 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-09093cc2-477e-40be-bd0e-20fc0c2d4111 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:29.789174 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=42 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:29.795318 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-09093cc2-477e-40be-bd0e-20fc0c2d4111 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:29.795899 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-09093cc2-477e-40be-bd0e-20fc0c2d4111 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:29.797314 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-09093cc2-477e-40be-bd0e-20fc0c2d4111 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:29.797874 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-09093cc2-477e-40be-bd0e-20fc0c2d4111 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:29.939704 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-09093cc2-477e-40be-bd0e-20fc0c2d4111 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:29.948537 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-09093cc2-477e-40be-bd0e-20fc0c2d4111 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:29.950548 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-09093cc2-477e-40be-bd0e-20fc0c2d4111 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:29.951749 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-09093cc2-477e-40be-bd0e-20fc0c2d4111 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1729 microversion: 2.20 time: 0.169401 May 25 15:08:29.953104 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 502/1018] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:29 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:30.544058 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a65a0564-612b-4c46-b128-53d1f1cfb071 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:30.544653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a65a0564-612b-4c46-b128-53d1f1cfb071 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:30.552221 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a65a0564-612b-4c46-b128-53d1f1cfb071 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:30.552732 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a65a0564-612b-4c46-b128-53d1f1cfb071 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:30.553455 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a65a0564-612b-4c46-b128-53d1f1cfb071 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:30.553897 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a65a0564-612b-4c46-b128-53d1f1cfb071 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:30.697409 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a65a0564-612b-4c46-b128-53d1f1cfb071 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:30.705825 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a65a0564-612b-4c46-b128-53d1f1cfb071 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.165741 May 25 15:08:30.706448 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 517/1019] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:30 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:30.970447 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-fd64b052-b82a-4a91-bd21-04d3c3b19981 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:30.971044 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-fd64b052-b82a-4a91-bd21-04d3c3b19981 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:30.977593 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fd64b052-b82a-4a91-bd21-04d3c3b19981 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:30.978057 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fd64b052-b82a-4a91-bd21-04d3c3b19981 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:30.978815 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fd64b052-b82a-4a91-bd21-04d3c3b19981 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:30.979246 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fd64b052-b82a-4a91-bd21-04d3c3b19981 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:31.127541 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-fd64b052-b82a-4a91-bd21-04d3c3b19981 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:31.136697 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-fd64b052-b82a-4a91-bd21-04d3c3b19981 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:31.138237 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-fd64b052-b82a-4a91-bd21-04d3c3b19981 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:31.139433 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-fd64b052-b82a-4a91-bd21-04d3c3b19981 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1729 microversion: 2.20 time: 0.173091 May 25 15:08:31.146418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 503/1020] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:30 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:31.724061 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-6121d808-0ec2-4df1-aab4-81b2940a4714 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:31.724995 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-6121d808-0ec2-4df1-aab4-81b2940a4714 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:31.732119 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6121d808-0ec2-4df1-aab4-81b2940a4714 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:31.732953 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6121d808-0ec2-4df1-aab4-81b2940a4714 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:31.733741 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6121d808-0ec2-4df1-aab4-81b2940a4714 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:31.734377 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6121d808-0ec2-4df1-aab4-81b2940a4714 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:31.871768 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-6121d808-0ec2-4df1-aab4-81b2940a4714 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:31.880881 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-6121d808-0ec2-4df1-aab4-81b2940a4714 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.160642 May 25 15:08:31.881776 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 518/1021] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:31 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:32.158897 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1c69d24d-56d3-41e5-8cf8-6bcad1678854 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:32.159473 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1c69d24d-56d3-41e5-8cf8-6bcad1678854 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:32.166392 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1c69d24d-56d3-41e5-8cf8-6bcad1678854 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:32.167107 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1c69d24d-56d3-41e5-8cf8-6bcad1678854 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:32.167892 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1c69d24d-56d3-41e5-8cf8-6bcad1678854 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:32.168523 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1c69d24d-56d3-41e5-8cf8-6bcad1678854 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:32.307311 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1c69d24d-56d3-41e5-8cf8-6bcad1678854 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:32.315594 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1c69d24d-56d3-41e5-8cf8-6bcad1678854 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:32.317135 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1c69d24d-56d3-41e5-8cf8-6bcad1678854 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:32.318375 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1c69d24d-56d3-41e5-8cf8-6bcad1678854 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1729 microversion: 2.20 time: 0.164091 May 25 15:08:32.319121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 504/1022] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:32 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:32.899169 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-49879ffa-dfcd-49ef-9692-333b4313aa18 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:32.899774 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-49879ffa-dfcd-49ef-9692-333b4313aa18 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:32.907543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-49879ffa-dfcd-49ef-9692-333b4313aa18 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:32.908060 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-49879ffa-dfcd-49ef-9692-333b4313aa18 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:32.908925 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-49879ffa-dfcd-49ef-9692-333b4313aa18 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:32.909424 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-49879ffa-dfcd-49ef-9692-333b4313aa18 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:33.057806 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-49879ffa-dfcd-49ef-9692-333b4313aa18 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:33.066308 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-49879ffa-dfcd-49ef-9692-333b4313aa18 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.170970 May 25 15:08:33.067026 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 519/1023] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:32 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:33.339839 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1d12a0eb-e151-4687-a0b6-5882cda43994 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:33.340379 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1d12a0eb-e151-4687-a0b6-5882cda43994 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:33.346936 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1d12a0eb-e151-4687-a0b6-5882cda43994 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:33.347392 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1d12a0eb-e151-4687-a0b6-5882cda43994 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:33.348178 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1d12a0eb-e151-4687-a0b6-5882cda43994 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:33.348620 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1d12a0eb-e151-4687-a0b6-5882cda43994 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:33.490857 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1d12a0eb-e151-4687-a0b6-5882cda43994 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:33.500345 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1d12a0eb-e151-4687-a0b6-5882cda43994 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:33.501861 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1d12a0eb-e151-4687-a0b6-5882cda43994 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:33.503076 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1d12a0eb-e151-4687-a0b6-5882cda43994 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1729 microversion: 2.20 time: 0.167268 May 25 15:08:33.503630 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 505/1024] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:33 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:34.084313 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-234829de-d155-4fec-a1db-b3c344d9e19f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:34.085009 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-234829de-d155-4fec-a1db-b3c344d9e19f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:34.091601 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-234829de-d155-4fec-a1db-b3c344d9e19f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:34.092054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-234829de-d155-4fec-a1db-b3c344d9e19f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:34.092835 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-234829de-d155-4fec-a1db-b3c344d9e19f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:34.093270 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-234829de-d155-4fec-a1db-b3c344d9e19f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:34.226271 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-234829de-d155-4fec-a1db-b3c344d9e19f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:34.234346 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-234829de-d155-4fec-a1db-b3c344d9e19f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.153409 May 25 15:08:34.234900 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 520/1025] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:34 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:34.521834 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1d785651-b342-4338-892b-9d5a6a1dd45a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:34.522455 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1d785651-b342-4338-892b-9d5a6a1dd45a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:34.528924 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1d785651-b342-4338-892b-9d5a6a1dd45a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:34.529373 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1d785651-b342-4338-892b-9d5a6a1dd45a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:34.530173 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1d785651-b342-4338-892b-9d5a6a1dd45a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:34.530647 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1d785651-b342-4338-892b-9d5a6a1dd45a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:34.661571 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1d785651-b342-4338-892b-9d5a6a1dd45a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:34.669803 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1d785651-b342-4338-892b-9d5a6a1dd45a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:34.671353 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1d785651-b342-4338-892b-9d5a6a1dd45a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:34.672522 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1d785651-b342-4338-892b-9d5a6a1dd45a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1729 microversion: 2.20 time: 0.154675 May 25 15:08:34.673077 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 506/1026] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:34 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:35.255681 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-96f4b9cf-ee9c-438d-9b65-e72e491c0d61 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:35.257138 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-96f4b9cf-ee9c-438d-9b65-e72e491c0d61 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:35.265195 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-96f4b9cf-ee9c-438d-9b65-e72e491c0d61 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:35.265637 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-96f4b9cf-ee9c-438d-9b65-e72e491c0d61 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:35.266509 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-96f4b9cf-ee9c-438d-9b65-e72e491c0d61 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:35.266939 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-96f4b9cf-ee9c-438d-9b65-e72e491c0d61 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:35.408582 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-96f4b9cf-ee9c-438d-9b65-e72e491c0d61 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:35.416321 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-96f4b9cf-ee9c-438d-9b65-e72e491c0d61 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.168658 May 25 15:08:35.416998 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 521/1027] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:35 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:35.690883 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-c439dd9e-4cd5-426c-a643-d3180bd55ea1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:35.691435 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-c439dd9e-4cd5-426c-a643-d3180bd55ea1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:35.698032 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c439dd9e-4cd5-426c-a643-d3180bd55ea1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:35.698482 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c439dd9e-4cd5-426c-a643-d3180bd55ea1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:35.699252 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c439dd9e-4cd5-426c-a643-d3180bd55ea1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:35.699686 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c439dd9e-4cd5-426c-a643-d3180bd55ea1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:35.833243 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-c439dd9e-4cd5-426c-a643-d3180bd55ea1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:35.841388 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-c439dd9e-4cd5-426c-a643-d3180bd55ea1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:35.843571 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-c439dd9e-4cd5-426c-a643-d3180bd55ea1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:35.844741 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-c439dd9e-4cd5-426c-a643-d3180bd55ea1 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1729 microversion: 2.20 time: 0.157942 May 25 15:08:35.845302 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 507/1028] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:35 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:36.436142 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-fb09db0b-7fbe-49ef-9510-bcba684c53f4 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:36.437432 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-fb09db0b-7fbe-49ef-9510-bcba684c53f4 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:36.444120 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fb09db0b-7fbe-49ef-9510-bcba684c53f4 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:36.444569 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fb09db0b-7fbe-49ef-9510-bcba684c53f4 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:36.445354 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fb09db0b-7fbe-49ef-9510-bcba684c53f4 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:36.445795 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-fb09db0b-7fbe-49ef-9510-bcba684c53f4 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:36.461270 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:36.584953 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-fb09db0b-7fbe-49ef-9510-bcba684c53f4 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:36.592682 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-fb09db0b-7fbe-49ef-9510-bcba684c53f4 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.160813 May 25 15:08:36.593879 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 522/1029] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:36 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:36.862835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-24758a67-48e3-4417-bada-8589ee6046cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:36.863439 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-24758a67-48e3-4417-bada-8589ee6046cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:36.870067 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-24758a67-48e3-4417-bada-8589ee6046cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:36.870517 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-24758a67-48e3-4417-bada-8589ee6046cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:36.871285 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-24758a67-48e3-4417-bada-8589ee6046cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:36.871721 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-24758a67-48e3-4417-bada-8589ee6046cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:37.002709 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-24758a67-48e3-4417-bada-8589ee6046cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:37.010462 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-24758a67-48e3-4417-bada-8589ee6046cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:37.012225 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-24758a67-48e3-4417-bada-8589ee6046cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:37.013369 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-24758a67-48e3-4417-bada-8589ee6046cf tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1729 microversion: 2.20 time: 0.154478 May 25 15:08:37.013923 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 508/1030] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:36 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:37.610376 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-12f37669-fe5f-4807-bb5e-b2d5b5b66667 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:37.610995 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-12f37669-fe5f-4807-bb5e-b2d5b5b66667 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:37.617727 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-12f37669-fe5f-4807-bb5e-b2d5b5b66667 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:37.618210 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-12f37669-fe5f-4807-bb5e-b2d5b5b66667 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:37.618986 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-12f37669-fe5f-4807-bb5e-b2d5b5b66667 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:37.619428 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-12f37669-fe5f-4807-bb5e-b2d5b5b66667 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:37.750209 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-12f37669-fe5f-4807-bb5e-b2d5b5b66667 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:37.757801 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-12f37669-fe5f-4807-bb5e-b2d5b5b66667 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.151392 May 25 15:08:37.758399 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 523/1031] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:37 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:38.032436 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-64eaf8fd-ba66-4da8-8b36-1b9466e14870 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:38.033052 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-64eaf8fd-ba66-4da8-8b36-1b9466e14870 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:38.039508 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-64eaf8fd-ba66-4da8-8b36-1b9466e14870 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:38.039959 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-64eaf8fd-ba66-4da8-8b36-1b9466e14870 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:38.040726 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-64eaf8fd-ba66-4da8-8b36-1b9466e14870 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:38.041157 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-64eaf8fd-ba66-4da8-8b36-1b9466e14870 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:38.174830 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-64eaf8fd-ba66-4da8-8b36-1b9466e14870 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:38.182825 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-64eaf8fd-ba66-4da8-8b36-1b9466e14870 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:38.184343 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-64eaf8fd-ba66-4da8-8b36-1b9466e14870 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:38.185508 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-64eaf8fd-ba66-4da8-8b36-1b9466e14870 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1729 microversion: 2.20 time: 0.157715 May 25 15:08:38.186085 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 509/1032] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:38 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:38.777367 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8d513243-674b-47af-9f83-0ecebe2175c8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:38.779475 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8d513243-674b-47af-9f83-0ecebe2175c8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:38.787177 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8d513243-674b-47af-9f83-0ecebe2175c8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:38.787645 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8d513243-674b-47af-9f83-0ecebe2175c8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:38.788441 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8d513243-674b-47af-9f83-0ecebe2175c8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:38.788955 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8d513243-674b-47af-9f83-0ecebe2175c8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:38.961579 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8d513243-674b-47af-9f83-0ecebe2175c8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:38.969784 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8d513243-674b-47af-9f83-0ecebe2175c8 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.198533 May 25 15:08:38.970396 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 524/1033] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:38 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:39.204847 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-66e76a4b-906d-4dbb-9a50-c0a2b066e5b3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:39.205535 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-66e76a4b-906d-4dbb-9a50-c0a2b066e5b3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:39.212149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-66e76a4b-906d-4dbb-9a50-c0a2b066e5b3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:39.212535 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-66e76a4b-906d-4dbb-9a50-c0a2b066e5b3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:39.213307 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-66e76a4b-906d-4dbb-9a50-c0a2b066e5b3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:39.213741 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-66e76a4b-906d-4dbb-9a50-c0a2b066e5b3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:39.354342 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-66e76a4b-906d-4dbb-9a50-c0a2b066e5b3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:39.362871 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-66e76a4b-906d-4dbb-9a50-c0a2b066e5b3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:39.364368 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-66e76a4b-906d-4dbb-9a50-c0a2b066e5b3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:39.365516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-66e76a4b-906d-4dbb-9a50-c0a2b066e5b3 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1729 microversion: 2.20 time: 0.165233 May 25 15:08:39.366097 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 510/1034] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:39 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:39.986818 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-1a0935c7-2cb3-4989-b85b-64cdfc836546 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:39.987428 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-1a0935c7-2cb3-4989-b85b-64cdfc836546 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:39.993967 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1a0935c7-2cb3-4989-b85b-64cdfc836546 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:39.994453 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1a0935c7-2cb3-4989-b85b-64cdfc836546 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:39.995217 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1a0935c7-2cb3-4989-b85b-64cdfc836546 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:39.995652 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-1a0935c7-2cb3-4989-b85b-64cdfc836546 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:40.141674 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-1a0935c7-2cb3-4989-b85b-64cdfc836546 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:40.149378 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-1a0935c7-2cb3-4989-b85b-64cdfc836546 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1509 microversion: 2.1 time: 0.166424 May 25 15:08:40.149960 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 525/1035] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:39 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:08:40.166233 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1f5187af-25fc-47c7-969e-6a97bba32b98 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:08:40.166814 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1f5187af-25fc-47c7-969e-6a97bba32b98 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:40.174275 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1f5187af-25fc-47c7-969e-6a97bba32b98 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:40.174733 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1f5187af-25fc-47c7-969e-6a97bba32b98 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:40.175512 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1f5187af-25fc-47c7-969e-6a97bba32b98 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:40.175955 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-1f5187af-25fc-47c7-969e-6a97bba32b98 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:40.190826 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-a94eb41a-8380-46c9-838b-924262a264a2 req-98036a39-913b-4915-b499-590d29e89677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4202b1b8-016d-4d26-ad4a-a2d3f6b58c65", "name": "network-vif-plugged", "status": "completed", "tag": "e6550da8-2d3f-49e5-ba79-3b3fb3daaf6a"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:08:40.200083 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-a94eb41a-8380-46c9-838b-924262a264a2 req-98036a39-913b-4915-b499-590d29e89677 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:40.200810 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-a94eb41a-8380-46c9-838b-924262a264a2 req-98036a39-913b-4915-b499-590d29e89677 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:40.214480 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-a94eb41a-8380-46c9-838b-924262a264a2 req-98036a39-913b-4915-b499-590d29e89677 service nova] Creating event network-vif-plugged:e6550da8-2d3f-49e5-ba79-3b3fb3daaf6a for instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 on hv-cinder-80382 May 25 15:08:40.220517 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-a94eb41a-8380-46c9-838b-924262a264a2 req-98036a39-913b-4915-b499-590d29e89677 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033242 May 25 15:08:40.221404 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 526/1036] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:08:40.277993 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1f5187af-25fc-47c7-969e-6a97bba32b98 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "POST /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5/action" status: 202 len: 0 microversion: 2.1 time: 0.115459 May 25 15:08:40.279000 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 511/1037] 10.222.0.78 () {60 vars in 1277 bytes} [Wed May 25 15:08:40 2022] POST /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:08:40.290277 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-badec23c-ffb6-4d34-a134-410c9fb0c7da tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:40.291298 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-badec23c-ffb6-4d34-a134-410c9fb0c7da tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:40.310192 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-badec23c-ffb6-4d34-a134-410c9fb0c7da tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:40.310645 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-badec23c-ffb6-4d34-a134-410c9fb0c7da tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:40.311481 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-badec23c-ffb6-4d34-a134-410c9fb0c7da tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:40.312087 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-badec23c-ffb6-4d34-a134-410c9fb0c7da tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:40.383970 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-33b621f2-9aa5-4c30-9045-281a9699a41d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:40.384805 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-33b621f2-9aa5-4c30-9045-281a9699a41d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:40.398131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-33b621f2-9aa5-4c30-9045-281a9699a41d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:40.399053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-33b621f2-9aa5-4c30-9045-281a9699a41d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:40.401734 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-33b621f2-9aa5-4c30-9045-281a9699a41d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:40.402128 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-33b621f2-9aa5-4c30-9045-281a9699a41d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:40.555246 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-33b621f2-9aa5-4c30-9045-281a9699a41d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:40.564042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-33b621f2-9aa5-4c30-9045-281a9699a41d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:40.565579 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-33b621f2-9aa5-4c30-9045-281a9699a41d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:40.567102 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-33b621f2-9aa5-4c30-9045-281a9699a41d tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1729 microversion: 2.20 time: 0.187361 May 25 15:08:40.568266 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 512/1038] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:40 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:08:40.609726 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-badec23c-ffb6-4d34-a134-410c9fb0c7da tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:40.617635 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-badec23c-ffb6-4d34-a134-410c9fb0c7da tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1517 microversion: 2.1 time: 0.333735 May 25 15:08:40.618495 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 527/1039] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:40 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1517 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:41.586605 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-e25426dd-dc1d-4ef6-b858-d6ef721ff68a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:41.587141 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-e25426dd-dc1d-4ef6-b858-d6ef721ff68a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:41.593817 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e25426dd-dc1d-4ef6-b858-d6ef721ff68a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:41.594298 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e25426dd-dc1d-4ef6-b858-d6ef721ff68a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:41.595065 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e25426dd-dc1d-4ef6-b858-d6ef721ff68a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:41.595506 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e25426dd-dc1d-4ef6-b858-d6ef721ff68a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:41.636014 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a44bae43-84d4-44e4-8616-775c221a8c05 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:41.636689 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a44bae43-84d4-44e4-8616-775c221a8c05 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:41.643817 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a44bae43-84d4-44e4-8616-775c221a8c05 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:41.644272 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a44bae43-84d4-44e4-8616-775c221a8c05 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:41.645055 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a44bae43-84d4-44e4-8616-775c221a8c05 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:41.645497 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a44bae43-84d4-44e4-8616-775c221a8c05 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:41.740511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-e25426dd-dc1d-4ef6-b858-d6ef721ff68a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:41.755447 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-e25426dd-dc1d-4ef6-b858-d6ef721ff68a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:41.770765 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-e25426dd-dc1d-4ef6-b858-d6ef721ff68a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:41.772506 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-e25426dd-dc1d-4ef6-b858-d6ef721ff68a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1729 microversion: 2.20 time: 0.189909 May 25 15:08:41.779530 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 513/1040] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:41 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:41.813526 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a44bae43-84d4-44e4-8616-775c221a8c05 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:41.822735 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a44bae43-84d4-44e4-8616-775c221a8c05 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1519 microversion: 2.1 time: 0.190579 May 25 15:08:41.823195 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 528/1041] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:41 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:08:42.240453 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-0830f93c-9c76-43ef-8c09-c982b44aa409 req-a115794a-e78c-4243-bf56-f182dfd7e8ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3433ac-9290-4294-83ad-1fa030982ca5", "name": "network-vif-unplugged", "status": "completed", "tag": "d91fb4f2-8eda-4755-a625-3d06bee0b78d"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:08:42.248746 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-0830f93c-9c76-43ef-8c09-c982b44aa409 req-a115794a-e78c-4243-bf56-f182dfd7e8ed service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:42.250000 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-0830f93c-9c76-43ef-8c09-c982b44aa409 req-a115794a-e78c-4243-bf56-f182dfd7e8ed service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:42.261639 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.compute.server_external_events [req-0830f93c-9c76-43ef-8c09-c982b44aa409 req-a115794a-e78c-4243-bf56-f182dfd7e8ed service nova] Unable to find a host for instance dc3433ac-9290-4294-83ad-1fa030982ca5. Dropping event network-vif-unplugged {{(pid=124524) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 25 15:08:42.262694 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-0830f93c-9c76-43ef-8c09-c982b44aa409 req-a115794a-e78c-4243-bf56-f182dfd7e8ed service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026305 May 25 15:08:42.263713 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 514/1042] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 25 15:08:42.796872 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-49b8b3e6-ffcb-421f-b0aa-14cdf93e7848 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:42.797484 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-49b8b3e6-ffcb-421f-b0aa-14cdf93e7848 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:42.804153 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-49b8b3e6-ffcb-421f-b0aa-14cdf93e7848 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:42.804599 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-49b8b3e6-ffcb-421f-b0aa-14cdf93e7848 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:42.805380 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-49b8b3e6-ffcb-421f-b0aa-14cdf93e7848 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:42.806153 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-49b8b3e6-ffcb-421f-b0aa-14cdf93e7848 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:42.839558 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-25d356b2-776d-4aec-8658-0bbee8f803fc tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:42.840194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-25d356b2-776d-4aec-8658-0bbee8f803fc tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:42.847355 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-25d356b2-776d-4aec-8658-0bbee8f803fc tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:42.847800 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-25d356b2-776d-4aec-8658-0bbee8f803fc tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:42.848563 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-25d356b2-776d-4aec-8658-0bbee8f803fc tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:42.848993 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-25d356b2-776d-4aec-8658-0bbee8f803fc tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:42.982667 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-25d356b2-776d-4aec-8658-0bbee8f803fc tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:42.991043 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-25d356b2-776d-4aec-8658-0bbee8f803fc tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1575 microversion: 2.1 time: 0.155313 May 25 15:08:42.991618 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 515/1043] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:42 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:08:42.995747 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-49b8b3e6-ffcb-421f-b0aa-14cdf93e7848 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:43.004490 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-49b8b3e6-ffcb-421f-b0aa-14cdf93e7848 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:43.006130 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-49b8b3e6-ffcb-421f-b0aa-14cdf93e7848 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:43.007462 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-49b8b3e6-ffcb-421f-b0aa-14cdf93e7848 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1716 microversion: 2.20 time: 0.214959 May 25 15:08:43.008135 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 529/1044] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:08:42 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1716 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:08:44.008219 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-f1153656-0c80-4de2-89f4-dc3655c32a8e tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:44.008829 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-f1153656-0c80-4de2-89f4-dc3655c32a8e tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:44.015722 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f1153656-0c80-4de2-89f4-dc3655c32a8e tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:44.016173 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f1153656-0c80-4de2-89f4-dc3655c32a8e tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:44.016947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f1153656-0c80-4de2-89f4-dc3655c32a8e tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:44.017381 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f1153656-0c80-4de2-89f4-dc3655c32a8e tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:44.146066 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-f1153656-0c80-4de2-89f4-dc3655c32a8e tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:44.149438 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:44.154349 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-f1153656-0c80-4de2-89f4-dc3655c32a8e tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1575 microversion: 2.1 time: 0.150056 May 25 15:08:44.154915 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 516/1045] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:44 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:08:45.172501 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-bc0c32c9-d7fb-48c1-b195-28c9dab4a1d6 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:45.173046 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-bc0c32c9-d7fb-48c1-b195-28c9dab4a1d6 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:45.179664 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bc0c32c9-d7fb-48c1-b195-28c9dab4a1d6 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:45.180118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bc0c32c9-d7fb-48c1-b195-28c9dab4a1d6 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:45.180886 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bc0c32c9-d7fb-48c1-b195-28c9dab4a1d6 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:45.181327 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-bc0c32c9-d7fb-48c1-b195-28c9dab4a1d6 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:45.314350 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-bc0c32c9-d7fb-48c1-b195-28c9dab4a1d6 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:45.321835 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-bc0c32c9-d7fb-48c1-b195-28c9dab4a1d6 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1575 microversion: 2.1 time: 0.154040 May 25 15:08:45.322453 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 530/1046] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:45 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:46.338794 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-345f27ef-3374-4219-a172-58ad1f91c7c1 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:46.339383 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-345f27ef-3374-4219-a172-58ad1f91c7c1 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:46.348165 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-345f27ef-3374-4219-a172-58ad1f91c7c1 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:46.348611 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-345f27ef-3374-4219-a172-58ad1f91c7c1 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:46.349365 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-345f27ef-3374-4219-a172-58ad1f91c7c1 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:46.349793 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-345f27ef-3374-4219-a172-58ad1f91c7c1 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:46.481267 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-345f27ef-3374-4219-a172-58ad1f91c7c1 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:46.489283 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-345f27ef-3374-4219-a172-58ad1f91c7c1 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1575 microversion: 2.1 time: 0.154324 May 25 15:08:46.489887 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 517/1047] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:46 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:47.506214 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-66ef9e2e-35d1-45ef-8f55-fe57d87be291 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:47.506829 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-66ef9e2e-35d1-45ef-8f55-fe57d87be291 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:47.513682 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-66ef9e2e-35d1-45ef-8f55-fe57d87be291 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:47.514159 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-66ef9e2e-35d1-45ef-8f55-fe57d87be291 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:47.515509 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-66ef9e2e-35d1-45ef-8f55-fe57d87be291 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:47.515941 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-66ef9e2e-35d1-45ef-8f55-fe57d87be291 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:47.651743 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-66ef9e2e-35d1-45ef-8f55-fe57d87be291 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:47.659285 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-66ef9e2e-35d1-45ef-8f55-fe57d87be291 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1575 microversion: 2.1 time: 0.157003 May 25 15:08:47.659846 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 531/1048] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:47 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:48.676930 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-11471fa3-693e-481f-b715-279b4f9889f2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:48.677544 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-11471fa3-693e-481f-b715-279b4f9889f2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:48.684216 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-11471fa3-693e-481f-b715-279b4f9889f2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:48.684668 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-11471fa3-693e-481f-b715-279b4f9889f2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:48.685437 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-11471fa3-693e-481f-b715-279b4f9889f2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:48.685884 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-11471fa3-693e-481f-b715-279b4f9889f2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:48.816768 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-11471fa3-693e-481f-b715-279b4f9889f2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:48.824281 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-11471fa3-693e-481f-b715-279b4f9889f2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1575 microversion: 2.1 time: 0.151232 May 25 15:08:48.824847 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 518/1049] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:48 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:49.840717 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4cadcfc3-8486-4579-b5a1-52a148db63e2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:49.841261 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4cadcfc3-8486-4579-b5a1-52a148db63e2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:49.848381 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4cadcfc3-8486-4579-b5a1-52a148db63e2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:49.848828 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4cadcfc3-8486-4579-b5a1-52a148db63e2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:49.849589 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4cadcfc3-8486-4579-b5a1-52a148db63e2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:49.850033 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4cadcfc3-8486-4579-b5a1-52a148db63e2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:49.980615 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4cadcfc3-8486-4579-b5a1-52a148db63e2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:49.988618 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4cadcfc3-8486-4579-b5a1-52a148db63e2 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1575 microversion: 2.1 time: 0.151885 May 25 15:08:49.989181 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 532/1050] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:49 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:51.006463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b583dcf2-d9b9-4ab5-8e55-48e3524ced7f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:51.007073 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b583dcf2-d9b9-4ab5-8e55-48e3524ced7f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:51.013996 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b583dcf2-d9b9-4ab5-8e55-48e3524ced7f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:51.014469 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b583dcf2-d9b9-4ab5-8e55-48e3524ced7f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:51.015240 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b583dcf2-d9b9-4ab5-8e55-48e3524ced7f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:51.015685 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b583dcf2-d9b9-4ab5-8e55-48e3524ced7f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:51.151119 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b583dcf2-d9b9-4ab5-8e55-48e3524ced7f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:51.160301 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b583dcf2-d9b9-4ab5-8e55-48e3524ced7f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1575 microversion: 2.1 time: 0.157557 May 25 15:08:51.160839 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 519/1051] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:51 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:52.178264 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-c2c3d5ea-acda-4f56-b89b-1f4475e98fcc tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:52.179070 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-c2c3d5ea-acda-4f56-b89b-1f4475e98fcc tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:52.185690 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c2c3d5ea-acda-4f56-b89b-1f4475e98fcc tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:52.186169 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c2c3d5ea-acda-4f56-b89b-1f4475e98fcc tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:52.186951 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c2c3d5ea-acda-4f56-b89b-1f4475e98fcc tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:52.187948 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c2c3d5ea-acda-4f56-b89b-1f4475e98fcc tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:52.323692 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-c2c3d5ea-acda-4f56-b89b-1f4475e98fcc tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:52.331520 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-c2c3d5ea-acda-4f56-b89b-1f4475e98fcc tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1575 microversion: 2.1 time: 0.157325 May 25 15:08:52.332097 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 533/1052] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:52 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:53.349395 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-aa00bb09-65dc-4aa3-af92-827538ad406f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:53.350423 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-aa00bb09-65dc-4aa3-af92-827538ad406f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:53.357443 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aa00bb09-65dc-4aa3-af92-827538ad406f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:53.357979 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aa00bb09-65dc-4aa3-af92-827538ad406f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:53.359038 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aa00bb09-65dc-4aa3-af92-827538ad406f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:53.359432 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-aa00bb09-65dc-4aa3-af92-827538ad406f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:53.490228 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-aa00bb09-65dc-4aa3-af92-827538ad406f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:53.497963 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-aa00bb09-65dc-4aa3-af92-827538ad406f tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1575 microversion: 2.1 time: 0.153665 May 25 15:08:53.498557 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 520/1053] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:53 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:54.174463 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-c53d6275-ab6f-4def-a598-8516902b18dd req-5c26eeeb-5661-44b9-9b36-b2741a319771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3433ac-9290-4294-83ad-1fa030982ca5", "name": "network-vif-plugged", "status": "completed", "tag": "d91fb4f2-8eda-4755-a625-3d06bee0b78d"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:08:54.183875 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-c53d6275-ab6f-4def-a598-8516902b18dd req-5c26eeeb-5661-44b9-9b36-b2741a319771 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:54.184355 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-c53d6275-ab6f-4def-a598-8516902b18dd req-5c26eeeb-5661-44b9-9b36-b2741a319771 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:54.196142 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-c53d6275-ab6f-4def-a598-8516902b18dd req-5c26eeeb-5661-44b9-9b36-b2741a319771 service nova] Creating event network-vif-plugged:d91fb4f2-8eda-4755-a625-3d06bee0b78d for instance dc3433ac-9290-4294-83ad-1fa030982ca5 on hv-cinder-80382 May 25 15:08:54.201165 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-c53d6275-ab6f-4def-a598-8516902b18dd req-5c26eeeb-5661-44b9-9b36-b2741a319771 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031147 May 25 15:08:54.201762 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 534/1054] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:08:54.515862 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-53fd2cb9-8590-4af3-b893-e8f1a37828f4 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:54.516475 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-53fd2cb9-8590-4af3-b893-e8f1a37828f4 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:54.523042 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-53fd2cb9-8590-4af3-b893-e8f1a37828f4 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:54.523493 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-53fd2cb9-8590-4af3-b893-e8f1a37828f4 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:54.524279 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-53fd2cb9-8590-4af3-b893-e8f1a37828f4 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:54.525300 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-53fd2cb9-8590-4af3-b893-e8f1a37828f4 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:54.660727 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-53fd2cb9-8590-4af3-b893-e8f1a37828f4 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:54.670036 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-53fd2cb9-8590-4af3-b893-e8f1a37828f4 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1575 microversion: 2.1 time: 0.158015 May 25 15:08:54.680056 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 521/1055] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:54 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:55.688618 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3cdadaa9-80d0-4b8c-bbd5-118933939b9b tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:55.689351 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-3cdadaa9-80d0-4b8c-bbd5-118933939b9b tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:55.695586 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3cdadaa9-80d0-4b8c-bbd5-118933939b9b tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:55.696034 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3cdadaa9-80d0-4b8c-bbd5-118933939b9b tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:55.696817 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3cdadaa9-80d0-4b8c-bbd5-118933939b9b tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:55.697234 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3cdadaa9-80d0-4b8c-bbd5-118933939b9b tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:55.832021 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-3cdadaa9-80d0-4b8c-bbd5-118933939b9b tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:55.840205 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3cdadaa9-80d0-4b8c-bbd5-118933939b9b tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1575 microversion: 2.1 time: 0.156285 May 25 15:08:55.840788 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 535/1056] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:55 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:56.857785 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d6b777f4-8bbc-448d-a28c-8f0131f4f96c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:56.858455 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d6b777f4-8bbc-448d-a28c-8f0131f4f96c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:56.865413 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d6b777f4-8bbc-448d-a28c-8f0131f4f96c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:56.865863 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d6b777f4-8bbc-448d-a28c-8f0131f4f96c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:56.866700 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d6b777f4-8bbc-448d-a28c-8f0131f4f96c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:56.867136 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d6b777f4-8bbc-448d-a28c-8f0131f4f96c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:57.014267 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d6b777f4-8bbc-448d-a28c-8f0131f4f96c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:57.021873 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d6b777f4-8bbc-448d-a28c-8f0131f4f96c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1575 microversion: 2.1 time: 0.168116 May 25 15:08:57.022479 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 522/1057] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:56 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:58.039014 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-6059f2cc-605b-4598-a67f-3e1e7711626c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:58.039627 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-6059f2cc-605b-4598-a67f-3e1e7711626c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:58.046212 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6059f2cc-605b-4598-a67f-3e1e7711626c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:58.046672 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6059f2cc-605b-4598-a67f-3e1e7711626c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:58.047472 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6059f2cc-605b-4598-a67f-3e1e7711626c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:58.047913 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6059f2cc-605b-4598-a67f-3e1e7711626c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:58.178760 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-6059f2cc-605b-4598-a67f-3e1e7711626c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:58.186443 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-6059f2cc-605b-4598-a67f-3e1e7711626c tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1562 microversion: 2.1 time: 0.151315 May 25 15:08:58.187011 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 536/1058] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:08:58 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:21.886646 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:09:21.887211 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Wed May 25 15:09:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:09:22.905089 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-f8eea39e-ea11-4d2d-80c0-60232c96743a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:22.905833 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-f8eea39e-ea11-4d2d-80c0-60232c96743a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:22.908443 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=43 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:22.909105 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=36 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:22.915877 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f8eea39e-ea11-4d2d-80c0-60232c96743a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:22.916329 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f8eea39e-ea11-4d2d-80c0-60232c96743a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:22.917107 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f8eea39e-ea11-4d2d-80c0-60232c96743a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:22.917548 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f8eea39e-ea11-4d2d-80c0-60232c96743a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:22.945844 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-f8eea39e-ea11-4d2d-80c0-60232c96743a tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044924 May 25 15:09:22.946419 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 523/1059] 10.222.0.78 () {60 vars in 1342 bytes} [Wed May 25 15:09:22 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:23.004499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-c95e257c-492e-48cf-9b8e-8039aaee5149 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:23.005105 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-c95e257c-492e-48cf-9b8e-8039aaee5149 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:23.007596 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=43 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:23.008390 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=79 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:23.014134 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c95e257c-492e-48cf-9b8e-8039aaee5149 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:23.014578 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c95e257c-492e-48cf-9b8e-8039aaee5149 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:23.015343 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c95e257c-492e-48cf-9b8e-8039aaee5149 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:23.015769 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c95e257c-492e-48cf-9b8e-8039aaee5149 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:23.041272 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-c95e257c-492e-48cf-9b8e-8039aaee5149 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Going to try to terminate instance {{(pid=124523) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:09:23.117979 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-c95e257c-492e-48cf-9b8e-8039aaee5149 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 204 len: 0 microversion: 2.20 time: 0.117095 May 25 15:09:23.118804 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 537/1060] 10.222.0.78 () {60 vars in 1279 bytes} [Wed May 25 15:09:22 2022] DELETE /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 15:09:23.128830 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b905af3d-3983-4cd9-bfd1-b6ab36d3f453 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:23.129452 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b905af3d-3983-4cd9-bfd1-b6ab36d3f453 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:23.135870 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b905af3d-3983-4cd9-bfd1-b6ab36d3f453 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:23.136315 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b905af3d-3983-4cd9-bfd1-b6ab36d3f453 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:23.137067 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b905af3d-3983-4cd9-bfd1-b6ab36d3f453 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:23.137492 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b905af3d-3983-4cd9-bfd1-b6ab36d3f453 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:23.265431 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b905af3d-3983-4cd9-bfd1-b6ab36d3f453 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:23.274120 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b905af3d-3983-4cd9-bfd1-b6ab36d3f453 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:23.275743 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b905af3d-3983-4cd9-bfd1-b6ab36d3f453 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:23.277251 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b905af3d-3983-4cd9-bfd1-b6ab36d3f453 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.153913 May 25 15:09:23.277815 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 524/1061] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:09:23 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:09:24.296027 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8473670b-4387-4f89-8f8a-c594ed1c3c3c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:24.296731 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8473670b-4387-4f89-8f8a-c594ed1c3c3c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:24.303465 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8473670b-4387-4f89-8f8a-c594ed1c3c3c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:24.303922 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8473670b-4387-4f89-8f8a-c594ed1c3c3c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:24.304685 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8473670b-4387-4f89-8f8a-c594ed1c3c3c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:24.305120 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8473670b-4387-4f89-8f8a-c594ed1c3c3c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:24.436767 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8473670b-4387-4f89-8f8a-c594ed1c3c3c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:24.445299 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8473670b-4387-4f89-8f8a-c594ed1c3c3c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:24.446833 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8473670b-4387-4f89-8f8a-c594ed1c3c3c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:24.447995 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8473670b-4387-4f89-8f8a-c594ed1c3c3c tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.156384 May 25 15:09:24.448556 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 538/1062] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:09:24 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:09:25.466340 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-929f547a-4c7b-46b9-962f-0326f3edd825 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:25.466878 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-929f547a-4c7b-46b9-962f-0326f3edd825 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:25.474500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-929f547a-4c7b-46b9-962f-0326f3edd825 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:25.475088 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-929f547a-4c7b-46b9-962f-0326f3edd825 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:25.476034 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-929f547a-4c7b-46b9-962f-0326f3edd825 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:25.476619 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-929f547a-4c7b-46b9-962f-0326f3edd825 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:25.620781 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-929f547a-4c7b-46b9-962f-0326f3edd825 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:25.629258 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-929f547a-4c7b-46b9-962f-0326f3edd825 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:25.630891 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-929f547a-4c7b-46b9-962f-0326f3edd825 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:25.632110 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-929f547a-4c7b-46b9-962f-0326f3edd825 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1722 microversion: 2.20 time: 0.169930 May 25 15:09:25.632678 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 525/1063] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:09:25 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:09:26.475978 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-1b19ba39-6681-4092-8d63-09d337ad6c85 req-10d6ac31-01b8-4c09-9901-426494f3db3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4202b1b8-016d-4d26-ad4a-a2d3f6b58c65", "name": "network-vif-deleted", "tag": "e6550da8-2d3f-49e5-ba79-3b3fb3daaf6a"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:09:26.485206 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-1b19ba39-6681-4092-8d63-09d337ad6c85 req-10d6ac31-01b8-4c09-9901-426494f3db3c service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:26.485939 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-1b19ba39-6681-4092-8d63-09d337ad6c85 req-10d6ac31-01b8-4c09-9901-426494f3db3c service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:26.499366 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-1b19ba39-6681-4092-8d63-09d337ad6c85 req-10d6ac31-01b8-4c09-9901-426494f3db3c service nova] Creating event network-vif-deleted:e6550da8-2d3f-49e5-ba79-3b3fb3daaf6a for instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 on hv-cinder-80382 May 25 15:09:26.507893 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-1b19ba39-6681-4092-8d63-09d337ad6c85 req-10d6ac31-01b8-4c09-9901-426494f3db3c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035213 May 25 15:09:26.509121 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 539/1064] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:09:26.651931 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-d077ce37-aa9a-405c-b3ff-40b84d58696f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:26.652699 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-d077ce37-aa9a-405c-b3ff-40b84d58696f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:26.659593 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d077ce37-aa9a-405c-b3ff-40b84d58696f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:26.660152 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d077ce37-aa9a-405c-b3ff-40b84d58696f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:26.661067 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d077ce37-aa9a-405c-b3ff-40b84d58696f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:26.661748 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d077ce37-aa9a-405c-b3ff-40b84d58696f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:26.697472 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d077ce37-aa9a-405c-b3ff-40b84d58696f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:26.698026 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-d077ce37-aa9a-405c-b3ff-40b84d58696f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:26.698712 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-d077ce37-aa9a-405c-b3ff-40b84d58696f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lazy-loading 'fault' on Instance uuid 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:09:26.739516 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d077ce37-aa9a-405c-b3ff-40b84d58696f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:26.747396 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d077ce37-aa9a-405c-b3ff-40b84d58696f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:26.748969 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-d077ce37-aa9a-405c-b3ff-40b84d58696f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34b1591b0eb944ed98c42d35a03c1ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b586a13e82f4177a7180f81acf675fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:26.750224 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-d077ce37-aa9a-405c-b3ff-40b84d58696f tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 200 len: 1370 microversion: 2.20 time: 0.102611 May 25 15:09:26.750798 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 526/1065] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:09:26 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 1370 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:09:27.771084 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ea33be00-1265-4cb9-91b8-4bef3610b94e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:27.771789 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ea33be00-1265-4cb9-91b8-4bef3610b94e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:27.778101 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ea33be00-1265-4cb9-91b8-4bef3610b94e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:27.778539 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ea33be00-1265-4cb9-91b8-4bef3610b94e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:27.779309 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ea33be00-1265-4cb9-91b8-4bef3610b94e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:27.779751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ea33be00-1265-4cb9-91b8-4bef3610b94e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:27.792866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-ea33be00-1265-4cb9-91b8-4bef3610b94e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] HTTP exception thrown: Instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 could not be found. May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ea33be00-1265-4cb9-91b8-4bef3610b94e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Request method failure captured: May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 HTTP/1.1 May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkUgp6m_kwxCAe9V3iT-kXjjxNWQpfy-pG3HImpEKDHtpajyzB-pjjCwd96lr6_nS1E3kSuWdbSoggTqUCK42Vc5UR6qQS1eRCgEYddjF1t0A_ITvmAA47Kdc7H9xzjYum6RmrKzNdAZxGIWBgoNytrHUrayNghy7e_wsMKoQbuTFpo May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Openstack-Nova-Api-Version: 2.20 May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 2b586a13e82f4177a7180f81acf675fd May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1960233767 May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:09:27.794529 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:09:27.796322 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2b586a13e82f4177a7180f81acf675fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2b586a13e82f4177a7180f81acf675fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b586a13e82f4177a7180f81acf675fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b586a13e82f4177a7180f81acf675fd"}]}] May 25 15:09:27.796322 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1960233767 May 25 15:09:27.796322 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 2b586a13e82f4177a7180f81acf675fd May 25 15:09:27.796322 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1960233767 May 25 15:09:27.796322 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-AttachVolumeShelveTestJSON-1960233767-project May 25 15:09:27.796322 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:09:27.796322 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:09:27.796322 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: 34b1591b0eb944ed98c42d35a03c1ff9 May 25 15:09:27.796322 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1960233767-project May 25 15:09:27.796322 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:09:27.796322 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 could not be found. May 25 15:09:27.796322 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': '4202b1b8-016d-4d26-ad4a-a2d3f6b58c65'} May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 could not be found. May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:09:27.797451 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:09:27.799056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:09:27.799056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:09:27.799056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:09:27.799056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:09:27.799056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:09:27.799056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:09:27.799056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:09:27.799056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 could not be found. May 25 15:09:27.799056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:09:27.799056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:09:27.799056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:09:27.799056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:27.799056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:09:27.799056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:09:27.799056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:09:27.799056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:09:27.799056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 could not be found. May 25 15:09:27.799056 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:09:27.800605 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ea33be00-1265-4cb9-91b8-4bef3610b94e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Returning 404 to user: Instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:09:27.800605 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ea33be00-1265-4cb9-91b8-4bef3610b94e tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 404 len: 111 microversion: 2.20 time: 0.030413 May 25 15:09:27.800605 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 540/1066] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:09:27 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 15:09:27.804805 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-167ede91-eed7-494c-bcc3-ca4275cf8ce2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '.version_select at 0x7fb1dadba280>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:27.827149 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-167ede91-eed7-494c-bcc3-ca4275cf8ce2 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1572626535" status: 204 len: 0 microversion: 2.20 time: 0.026091 May 25 15:09:27.827737 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 527/1067] 10.222.0.78 () {60 vars in 1261 bytes} [Wed May 25 15:09:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1572626535 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 15:09:29.871885 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-6bde5b59-36d9-4514-ad03-60edcc520260 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:29.872422 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-6bde5b59-36d9-4514-ad03-60edcc520260 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:29.878966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6bde5b59-36d9-4514-ad03-60edcc520260 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:29.879430 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6bde5b59-36d9-4514-ad03-60edcc520260 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:29.880231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6bde5b59-36d9-4514-ad03-60edcc520260 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:29.880682 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6bde5b59-36d9-4514-ad03-60edcc520260 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:29.894486 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-6bde5b59-36d9-4514-ad03-60edcc520260 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] HTTP exception thrown: Instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 could not be found. May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-6bde5b59-36d9-4514-ad03-60edcc520260 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Request method failure captured: May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: DELETE /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 HTTP/1.1 May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkUgp6m_kwxCAe9V3iT-kXjjxNWQpfy-pG3HImpEKDHtpajyzB-pjjCwd96lr6_nS1E3kSuWdbSoggTqUCK42Vc5UR6qQS1eRCgEYddjF1t0A_ITvmAA47Kdc7H9xzjYum6RmrKzNdAZxGIWBgoNytrHUrayNghy7e_wsMKoQbuTFpo May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Openstack-Nova-Api-Version: 2.20 May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 2b586a13e82f4177a7180f81acf675fd May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1960233767 May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:09:29.896620 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:09:29.898349 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2b586a13e82f4177a7180f81acf675fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2b586a13e82f4177a7180f81acf675fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b586a13e82f4177a7180f81acf675fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b586a13e82f4177a7180f81acf675fd"}]}] May 25 15:09:29.898349 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1960233767 May 25 15:09:29.898349 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 2b586a13e82f4177a7180f81acf675fd May 25 15:09:29.898349 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1960233767 May 25 15:09:29.898349 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-AttachVolumeShelveTestJSON-1960233767-project May 25 15:09:29.898349 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:09:29.898349 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:09:29.898349 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: 34b1591b0eb944ed98c42d35a03c1ff9 May 25 15:09:29.898349 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1960233767-project May 25 15:09:29.898349 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:09:29.898349 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 could not be found. May 25 15:09:29.898349 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': '4202b1b8-016d-4d26-ad4a-a2d3f6b58c65'} May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 could not be found. May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:09:29.899236 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 could not be found. May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 could not be found. May 25 15:09:29.900504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:09:29.901904 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-6bde5b59-36d9-4514-ad03-60edcc520260 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Returning 404 to user: Instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:09:29.901904 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-6bde5b59-36d9-4514-ad03-60edcc520260 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 404 len: 111 microversion: 2.20 time: 0.029993 May 25 15:09:29.901904 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 541/1068] 10.222.0.78 () {60 vars in 1279 bytes} [Wed May 25 15:09:29 2022] DELETE /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 15:09:29.907473 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-4712ce60-18b8-48dc-851e-c4bbe55c6481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:29.908093 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-4712ce60-18b8-48dc-851e-c4bbe55c6481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:29.915744 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4712ce60-18b8-48dc-851e-c4bbe55c6481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:29.916235 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4712ce60-18b8-48dc-851e-c4bbe55c6481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:29.916971 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4712ce60-18b8-48dc-851e-c4bbe55c6481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:29.917406 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4712ce60-18b8-48dc-851e-c4bbe55c6481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:29.930479 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-4712ce60-18b8-48dc-851e-c4bbe55c6481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] HTTP exception thrown: Instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 could not be found. May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-4712ce60-18b8-48dc-851e-c4bbe55c6481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Request method failure captured: May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 HTTP/1.1 May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkUgp6m_kwxCAe9V3iT-kXjjxNWQpfy-pG3HImpEKDHtpajyzB-pjjCwd96lr6_nS1E3kSuWdbSoggTqUCK42Vc5UR6qQS1eRCgEYddjF1t0A_ITvmAA47Kdc7H9xzjYum6RmrKzNdAZxGIWBgoNytrHUrayNghy7e_wsMKoQbuTFpo May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Openstack-Nova-Api-Version: 2.20 May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 2b586a13e82f4177a7180f81acf675fd May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1960233767 May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:09:29.932123 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:09:29.933980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2b586a13e82f4177a7180f81acf675fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2b586a13e82f4177a7180f81acf675fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b586a13e82f4177a7180f81acf675fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b586a13e82f4177a7180f81acf675fd"}]}] May 25 15:09:29.933980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1960233767 May 25 15:09:29.933980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 2b586a13e82f4177a7180f81acf675fd May 25 15:09:29.933980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1960233767 May 25 15:09:29.933980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-AttachVolumeShelveTestJSON-1960233767-project May 25 15:09:29.933980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:09:29.933980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:09:29.933980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: 34b1591b0eb944ed98c42d35a03c1ff9 May 25 15:09:29.933980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1960233767-project May 25 15:09:29.933980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:09:29.933980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 could not be found. May 25 15:09:29.933980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': '4202b1b8-016d-4d26-ad4a-a2d3f6b58c65'} May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 could not be found. May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:09:29.934907 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:09:29.936403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:09:29.936403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:09:29.936403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:09:29.936403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:09:29.936403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:09:29.936403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:09:29.936403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:09:29.936403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 could not be found. May 25 15:09:29.936403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:09:29.936403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:09:29.936403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:09:29.936403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:29.936403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:09:29.936403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:09:29.936403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:09:29.936403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:09:29.936403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 could not be found. May 25 15:09:29.936403 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:09:29.937681 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-4712ce60-18b8-48dc-851e-c4bbe55c6481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Returning 404 to user: Instance 4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:09:29.937681 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-4712ce60-18b8-48dc-851e-c4bbe55c6481 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65" status: 404 len: 111 microversion: 2.20 time: 0.030620 May 25 15:09:29.937681 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 528/1069] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:09:29 2022] GET /compute/v2.1/servers/4202b1b8-016d-4d26-ad4a-a2d3f6b58c65 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 15:09:31.074813 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a5f331c8-34b8-4ec4-86d3-5cf13ddc2549 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:31.075343 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a5f331c8-34b8-4ec4-86d3-5cf13ddc2549 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:31.081739 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a5f331c8-34b8-4ec4-86d3-5cf13ddc2549 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:31.082222 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a5f331c8-34b8-4ec4-86d3-5cf13ddc2549 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:31.083526 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a5f331c8-34b8-4ec4-86d3-5cf13ddc2549 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:31.083944 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a5f331c8-34b8-4ec4-86d3-5cf13ddc2549 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:31.097385 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-a5f331c8-34b8-4ec4-86d3-5cf13ddc2549 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] HTTP exception thrown: Instance 879adce9-e352-4e39-b80b-dcaee814c084 could not be found. May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a5f331c8-34b8-4ec4-86d3-5cf13ddc2549 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Request method failure captured: May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: DELETE /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 HTTP/1.1 May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkUgp6m_kwxCAe9V3iT-kXjjxNWQpfy-pG3HImpEKDHtpajyzB-pjjCwd96lr6_nS1E3kSuWdbSoggTqUCK42Vc5UR6qQS1eRCgEYddjF1t0A_ITvmAA47Kdc7H9xzjYum6RmrKzNdAZxGIWBgoNytrHUrayNghy7e_wsMKoQbuTFpo May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Openstack-Nova-Api-Version: 2.20 May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 2b586a13e82f4177a7180f81acf675fd May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1960233767 May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:09:31.099603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:09:31.101288 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2b586a13e82f4177a7180f81acf675fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2b586a13e82f4177a7180f81acf675fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b586a13e82f4177a7180f81acf675fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b586a13e82f4177a7180f81acf675fd"}]}] May 25 15:09:31.101288 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1960233767 May 25 15:09:31.101288 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 2b586a13e82f4177a7180f81acf675fd May 25 15:09:31.101288 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1960233767 May 25 15:09:31.101288 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-AttachVolumeShelveTestJSON-1960233767-project May 25 15:09:31.101288 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:09:31.101288 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:09:31.101288 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: 34b1591b0eb944ed98c42d35a03c1ff9 May 25 15:09:31.101288 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1960233767-project May 25 15:09:31.101288 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:09:31.101288 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance 879adce9-e352-4e39-b80b-dcaee814c084 could not be found. May 25 15:09:31.101288 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': '879adce9-e352-4e39-b80b-dcaee814c084'} May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879adce9-e352-4e39-b80b-dcaee814c084 could not be found. May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:09:31.102375 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879adce9-e352-4e39-b80b-dcaee814c084 could not be found. May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879adce9-e352-4e39-b80b-dcaee814c084 could not be found. May 25 15:09:31.103866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:09:31.105539 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a5f331c8-34b8-4ec4-86d3-5cf13ddc2549 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Returning 404 to user: Instance 879adce9-e352-4e39-b80b-dcaee814c084 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:09:31.105539 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a5f331c8-34b8-4ec4-86d3-5cf13ddc2549 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "DELETE /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 404 len: 111 microversion: 2.20 time: 0.030032 May 25 15:09:31.105539 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 542/1070] 10.222.0.78 () {60 vars in 1279 bytes} [Wed May 25 15:09:31 2022] DELETE /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 15:09:31.109389 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2a52bf35-e04e-44f7-a0f2-d395b3e4e360 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:31.110003 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-2a52bf35-e04e-44f7-a0f2-d395b3e4e360 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] [instance: 879adce9-e352-4e39-b80b-dcaee814c084] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:31.116488 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2a52bf35-e04e-44f7-a0f2-d395b3e4e360 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:31.116942 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2a52bf35-e04e-44f7-a0f2-d395b3e4e360 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:31.117712 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2a52bf35-e04e-44f7-a0f2-d395b3e4e360 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:31.118177 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-2a52bf35-e04e-44f7-a0f2-d395b3e4e360 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:31.131348 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-2a52bf35-e04e-44f7-a0f2-d395b3e4e360 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] HTTP exception thrown: Instance 879adce9-e352-4e39-b80b-dcaee814c084 could not be found. May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2a52bf35-e04e-44f7-a0f2-d395b3e4e360 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Request method failure captured: May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 HTTP/1.1 May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkUgp6m_kwxCAe9V3iT-kXjjxNWQpfy-pG3HImpEKDHtpajyzB-pjjCwd96lr6_nS1E3kSuWdbSoggTqUCK42Vc5UR6qQS1eRCgEYddjF1t0A_ITvmAA47Kdc7H9xzjYum6RmrKzNdAZxGIWBgoNytrHUrayNghy7e_wsMKoQbuTFpo May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Openstack-Nova-Api-Version: 2.20 May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 2b586a13e82f4177a7180f81acf675fd May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1960233767 May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:09:31.132866 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:09:31.134619 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2b586a13e82f4177a7180f81acf675fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2b586a13e82f4177a7180f81acf675fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b586a13e82f4177a7180f81acf675fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b586a13e82f4177a7180f81acf675fd"}]}] May 25 15:09:31.134619 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1960233767 May 25 15:09:31.134619 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 2b586a13e82f4177a7180f81acf675fd May 25 15:09:31.134619 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1960233767 May 25 15:09:31.134619 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-AttachVolumeShelveTestJSON-1960233767-project May 25 15:09:31.134619 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:09:31.134619 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:09:31.134619 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: 34b1591b0eb944ed98c42d35a03c1ff9 May 25 15:09:31.134619 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1960233767-project May 25 15:09:31.134619 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:09:31.134619 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance 879adce9-e352-4e39-b80b-dcaee814c084 could not be found. May 25 15:09:31.134619 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': '879adce9-e352-4e39-b80b-dcaee814c084'} May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879adce9-e352-4e39-b80b-dcaee814c084 could not be found. May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:09:31.135952 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:09:31.137445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:09:31.137445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:09:31.137445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:09:31.137445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:09:31.137445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:09:31.137445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:09:31.137445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:09:31.137445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879adce9-e352-4e39-b80b-dcaee814c084 could not be found. May 25 15:09:31.137445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:09:31.137445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:09:31.137445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:09:31.137445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:31.137445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:09:31.137445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:09:31.137445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:09:31.137445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:09:31.137445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879adce9-e352-4e39-b80b-dcaee814c084 could not be found. May 25 15:09:31.137445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:09:31.139118 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-2a52bf35-e04e-44f7-a0f2-d395b3e4e360 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] Returning 404 to user: Instance 879adce9-e352-4e39-b80b-dcaee814c084 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:09:31.139118 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-2a52bf35-e04e-44f7-a0f2-d395b3e4e360 tempest-AttachVolumeShelveTestJSON-1960233767 tempest-AttachVolumeShelveTestJSON-1960233767-project] 10.222.0.78 "GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084" status: 404 len: 111 microversion: 2.20 time: 0.028744 May 25 15:09:31.139118 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 529/1071] 10.222.0.78 () {60 vars in 1276 bytes} [Wed May 25 15:09:31 2022] GET /compute/v2.1/servers/879adce9-e352-4e39-b80b-dcaee814c084 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 15:09:40.656865 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8c9e326a-da3c-4c20-bb99-21d7381c9aaf tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1427444444", "imageRef": "fbec7c78-0103-4632-9a21-d8e8056f2ce0", "flavorRef": "452", "networks": [{"uuid": "c4655b03-936b-48cf-a983-64dc8b3e6136"}]}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:09:40.713636 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.network.neutron [None req-8c9e326a-da3c-4c20-bb99-21d7381c9aaf tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] validate_networks() for [('c4655b03-936b-48cf-a983-64dc8b3e6136', None, None, None, None, None)] {{(pid=124523) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:09:41.068860 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-8c9e326a-da3c-4c20-bb99-21d7381c9aaf tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Flavor limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:09:41.069280 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-8c9e326a-da3c-4c20-bb99-21d7381c9aaf tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Image limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:09:41.069830 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-8c9e326a-da3c-4c20-bb99-21d7381c9aaf tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Flavor pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:09:41.070260 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-8c9e326a-da3c-4c20-bb99-21d7381c9aaf tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Image pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:09:41.070675 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-8c9e326a-da3c-4c20-bb99-21d7381c9aaf tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:09:41.079528 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8c9e326a-da3c-4c20-bb99-21d7381c9aaf tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:41.079907 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8c9e326a-da3c-4c20-bb99-21d7381c9aaf tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:41.080703 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8c9e326a-da3c-4c20-bb99-21d7381c9aaf tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:41.081141 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8c9e326a-da3c-4c20-bb99-21d7381c9aaf tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:41.099720 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-8c9e326a-da3c-4c20-bb99-21d7381c9aaf tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Getting quotas for project ff8783629b6944c8ab6f93cbba5163ea. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:09:41.103779 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-8c9e326a-da3c-4c20-bb99-21d7381c9aaf tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Getting quotas for user f6a2c1100f834ac0ad12157d48bc258b and project ff8783629b6944c8ab6f93cbba5163ea. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:09:41.115349 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8c9e326a-da3c-4c20-bb99-21d7381c9aaf tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Going to run 1 instances... {{(pid=124523) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:09:41.117621 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8c9e326a-da3c-4c20-bb99-21d7381c9aaf tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: a088199d-3a9f-4603-b4d2-c1114297b955] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbec7c78-0103-4632-9a21-d8e8056f2ce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:09:41.163340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8c9e326a-da3c-4c20-bb99-21d7381c9aaf tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510391 May 25 15:09:41.164117 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 543/1072] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 15:09:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:09:41.175057 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-1e4d9b22-5797-420e-92ee-315890894e2c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:41.175765 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-1e4d9b22-5797-420e-92ee-315890894e2c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: a088199d-3a9f-4603-b4d2-c1114297b955] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:41.178449 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:41.179295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=30 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:41.236017 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-1e4d9b22-5797-420e-92ee-315890894e2c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:41.243962 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-1e4d9b22-5797-420e-92ee-315890894e2c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955" status: 200 len: 1214 microversion: 2.1 time: 0.072960 May 25 15:09:41.244556 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 530/1073] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:09:41 2022] GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:42.261806 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-c2f6a4ce-101d-4933-8097-8997b9636517 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:42.262551 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-c2f6a4ce-101d-4933-8097-8997b9636517 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: a088199d-3a9f-4603-b4d2-c1114297b955] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:42.269328 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c2f6a4ce-101d-4933-8097-8997b9636517 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:42.270668 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c2f6a4ce-101d-4933-8097-8997b9636517 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:42.271465 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c2f6a4ce-101d-4933-8097-8997b9636517 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:42.272073 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c2f6a4ce-101d-4933-8097-8997b9636517 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:42.348912 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-c2f6a4ce-101d-4933-8097-8997b9636517 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:42.357611 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-c2f6a4ce-101d-4933-8097-8997b9636517 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955" status: 200 len: 1274 microversion: 2.1 time: 0.100149 May 25 15:09:42.358245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 544/1074] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:09:42 2022] GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955 => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:43.378813 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-4350085b-5747-4d9b-afba-9827f8d611b2 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:43.380112 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-4350085b-5747-4d9b-afba-9827f8d611b2 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: a088199d-3a9f-4603-b4d2-c1114297b955] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:43.394028 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4350085b-5747-4d9b-afba-9827f8d611b2 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:43.394492 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4350085b-5747-4d9b-afba-9827f8d611b2 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:43.395781 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4350085b-5747-4d9b-afba-9827f8d611b2 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:43.396218 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-4350085b-5747-4d9b-afba-9827f8d611b2 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:43.540241 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-4350085b-5747-4d9b-afba-9827f8d611b2 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:43.547797 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-4350085b-5747-4d9b-afba-9827f8d611b2 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955" status: 200 len: 1314 microversion: 2.1 time: 0.176485 May 25 15:09:43.548378 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 531/1075] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:09:43 2022] GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:43.671413 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-e3b85048-a5ce-4d41-bbe6-ccb541f85942 req-a114aac1-11e2-4466-ab94-6d80c995338d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a088199d-3a9f-4603-b4d2-c1114297b955", "tag": "badf52ad-4717-495a-90d8-236d0942fd5e"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:09:43.680350 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-e3b85048-a5ce-4d41-bbe6-ccb541f85942 req-a114aac1-11e2-4466-ab94-6d80c995338d service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:43.680734 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-e3b85048-a5ce-4d41-bbe6-ccb541f85942 req-a114aac1-11e2-4466-ab94-6d80c995338d service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:43.693107 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-e3b85048-a5ce-4d41-bbe6-ccb541f85942 req-a114aac1-11e2-4466-ab94-6d80c995338d service nova] Creating event network-changed:badf52ad-4717-495a-90d8-236d0942fd5e for instance a088199d-3a9f-4603-b4d2-c1114297b955 on hv-cinder-80382 May 25 15:09:43.698033 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-e3b85048-a5ce-4d41-bbe6-ccb541f85942 req-a114aac1-11e2-4466-ab94-6d80c995338d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030452 May 25 15:09:43.698623 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 545/1076] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:09:44.565119 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-74d55c48-5ab2-4960-8791-a6ccf18f24bc tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:44.565710 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-74d55c48-5ab2-4960-8791-a6ccf18f24bc tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: a088199d-3a9f-4603-b4d2-c1114297b955] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:44.572344 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-74d55c48-5ab2-4960-8791-a6ccf18f24bc tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:44.572792 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-74d55c48-5ab2-4960-8791-a6ccf18f24bc tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:44.573563 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-74d55c48-5ab2-4960-8791-a6ccf18f24bc tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:44.574050 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-74d55c48-5ab2-4960-8791-a6ccf18f24bc tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:44.703905 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-74d55c48-5ab2-4960-8791-a6ccf18f24bc tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:44.711937 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-74d55c48-5ab2-4960-8791-a6ccf18f24bc tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955" status: 200 len: 1314 microversion: 2.1 time: 0.150691 May 25 15:09:44.712502 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 532/1077] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:09:44 2022] GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:45.729577 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-3ec0a590-9e36-437b-bf67-668a24caa994 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:45.730224 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-3ec0a590-9e36-437b-bf67-668a24caa994 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: a088199d-3a9f-4603-b4d2-c1114297b955] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:45.736444 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3ec0a590-9e36-437b-bf67-668a24caa994 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:45.736879 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3ec0a590-9e36-437b-bf67-668a24caa994 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:45.737635 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3ec0a590-9e36-437b-bf67-668a24caa994 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:45.738091 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-3ec0a590-9e36-437b-bf67-668a24caa994 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:45.866213 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-3ec0a590-9e36-437b-bf67-668a24caa994 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:45.873819 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-3ec0a590-9e36-437b-bf67-668a24caa994 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955" status: 200 len: 1314 microversion: 2.1 time: 0.148939 May 25 15:09:45.874417 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 546/1078] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:09:45 2022] GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:46.891358 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7cce20e3-2e4f-466d-b5c8-d626948a130b tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:46.892557 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7cce20e3-2e4f-466d-b5c8-d626948a130b tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: a088199d-3a9f-4603-b4d2-c1114297b955] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:46.899902 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7cce20e3-2e4f-466d-b5c8-d626948a130b tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:46.900353 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7cce20e3-2e4f-466d-b5c8-d626948a130b tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:46.901127 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7cce20e3-2e4f-466d-b5c8-d626948a130b tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:46.901561 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7cce20e3-2e4f-466d-b5c8-d626948a130b tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:47.029005 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7cce20e3-2e4f-466d-b5c8-d626948a130b tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:47.037391 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7cce20e3-2e4f-466d-b5c8-d626948a130b tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955" status: 200 len: 1314 microversion: 2.1 time: 0.149918 May 25 15:09:47.037957 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 533/1079] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:09:46 2022] GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:48.054745 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-b88f8611-1fc2-4966-9950-be17a4e8a9a0 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:48.055359 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-b88f8611-1fc2-4966-9950-be17a4e8a9a0 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: a088199d-3a9f-4603-b4d2-c1114297b955] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:48.061943 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b88f8611-1fc2-4966-9950-be17a4e8a9a0 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:48.062421 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b88f8611-1fc2-4966-9950-be17a4e8a9a0 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:48.063196 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b88f8611-1fc2-4966-9950-be17a4e8a9a0 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:48.063638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-b88f8611-1fc2-4966-9950-be17a4e8a9a0 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:48.197112 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-b88f8611-1fc2-4966-9950-be17a4e8a9a0 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:48.204735 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-b88f8611-1fc2-4966-9950-be17a4e8a9a0 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955" status: 200 len: 1314 microversion: 2.1 time: 0.154568 May 25 15:09:48.205315 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 547/1080] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:09:48 2022] GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:48.402084 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-2efe8c4f-ce4a-4e62-a2dc-9f0674f31b43 req-c5314bc3-cc21-406a-a349-2ed1fce16350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a088199d-3a9f-4603-b4d2-c1114297b955", "name": "network-vif-plugged", "status": "completed", "tag": "badf52ad-4717-495a-90d8-236d0942fd5e"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:09:48.411541 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-2efe8c4f-ce4a-4e62-a2dc-9f0674f31b43 req-c5314bc3-cc21-406a-a349-2ed1fce16350 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:48.411981 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-2efe8c4f-ce4a-4e62-a2dc-9f0674f31b43 req-c5314bc3-cc21-406a-a349-2ed1fce16350 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:48.429854 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-2efe8c4f-ce4a-4e62-a2dc-9f0674f31b43 req-c5314bc3-cc21-406a-a349-2ed1fce16350 service nova] Creating event network-vif-plugged:badf52ad-4717-495a-90d8-236d0942fd5e for instance a088199d-3a9f-4603-b4d2-c1114297b955 on hv-cinder-80382 May 25 15:09:48.441301 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-2efe8c4f-ce4a-4e62-a2dc-9f0674f31b43 req-c5314bc3-cc21-406a-a349-2ed1fce16350 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042352 May 25 15:09:48.442755 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 534/1081] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:09:49.221597 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8382def2-5a91-4655-9de0-438012cb9d90 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:49.222185 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8382def2-5a91-4655-9de0-438012cb9d90 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: a088199d-3a9f-4603-b4d2-c1114297b955] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:49.228880 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8382def2-5a91-4655-9de0-438012cb9d90 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:49.229334 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8382def2-5a91-4655-9de0-438012cb9d90 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:49.230148 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8382def2-5a91-4655-9de0-438012cb9d90 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:49.230590 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8382def2-5a91-4655-9de0-438012cb9d90 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:49.365001 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8382def2-5a91-4655-9de0-438012cb9d90 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:49.372613 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8382def2-5a91-4655-9de0-438012cb9d90 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955" status: 200 len: 1314 microversion: 2.1 time: 0.154981 May 25 15:09:49.373178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 548/1082] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:09:49 2022] GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:50.391913 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-f3ece52e-3768-4882-994a-685ec74ed18b tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:50.392623 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-f3ece52e-3768-4882-994a-685ec74ed18b tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: a088199d-3a9f-4603-b4d2-c1114297b955] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:50.400140 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f3ece52e-3768-4882-994a-685ec74ed18b tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:50.400587 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f3ece52e-3768-4882-994a-685ec74ed18b tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:50.401384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f3ece52e-3768-4882-994a-685ec74ed18b tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:50.401829 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-f3ece52e-3768-4882-994a-685ec74ed18b tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:50.538492 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-f3ece52e-3768-4882-994a-685ec74ed18b tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:50.545980 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-f3ece52e-3768-4882-994a-685ec74ed18b tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955" status: 200 len: 1499 microversion: 2.1 time: 0.159022 May 25 15:09:50.546570 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 535/1083] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:09:50 2022] GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955 => generated 1499 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:51.121667 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-38fbac51-bfd3-4bd0-9ec2-df86081bf34c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:51.122288 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-38fbac51-bfd3-4bd0-9ec2-df86081bf34c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: a088199d-3a9f-4603-b4d2-c1114297b955] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:51.124534 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=2 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:51.125198 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=6 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:51.130696 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-38fbac51-bfd3-4bd0-9ec2-df86081bf34c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:51.131174 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-38fbac51-bfd3-4bd0-9ec2-df86081bf34c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:51.131956 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-38fbac51-bfd3-4bd0-9ec2-df86081bf34c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:51.132398 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-38fbac51-bfd3-4bd0-9ec2-df86081bf34c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:51.159314 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-38fbac51-bfd3-4bd0-9ec2-df86081bf34c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: a088199d-3a9f-4603-b4d2-c1114297b955] Going to try to terminate instance {{(pid=124523) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:09:51.233026 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-38fbac51-bfd3-4bd0-9ec2-df86081bf34c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955" status: 204 len: 0 microversion: 2.1 time: 0.115016 May 25 15:09:51.233730 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 549/1084] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:09:51 2022] DELETE /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:09:51.243415 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b4e6ba9f-4e6d-47e9-ba81-5a2ebd53e6ce tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:51.244021 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b4e6ba9f-4e6d-47e9-ba81-5a2ebd53e6ce tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: a088199d-3a9f-4603-b4d2-c1114297b955] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:51.246166 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:51.251811 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b4e6ba9f-4e6d-47e9-ba81-5a2ebd53e6ce tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:51.252262 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b4e6ba9f-4e6d-47e9-ba81-5a2ebd53e6ce tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:51.253030 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b4e6ba9f-4e6d-47e9-ba81-5a2ebd53e6ce tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:51.253469 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b4e6ba9f-4e6d-47e9-ba81-5a2ebd53e6ce tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:51.387661 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b4e6ba9f-4e6d-47e9-ba81-5a2ebd53e6ce tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:51.395664 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b4e6ba9f-4e6d-47e9-ba81-5a2ebd53e6ce tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955" status: 200 len: 1505 microversion: 2.1 time: 0.156098 May 25 15:09:51.396299 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 536/1085] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:09:51 2022] GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:52.413333 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-5e40be49-4975-4270-996c-02ba4ea11967 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:52.414059 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-5e40be49-4975-4270-996c-02ba4ea11967 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: a088199d-3a9f-4603-b4d2-c1114297b955] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:52.420590 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5e40be49-4975-4270-996c-02ba4ea11967 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:52.421044 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5e40be49-4975-4270-996c-02ba4ea11967 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:52.421811 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5e40be49-4975-4270-996c-02ba4ea11967 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:52.422283 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5e40be49-4975-4270-996c-02ba4ea11967 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:52.555511 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5e40be49-4975-4270-996c-02ba4ea11967 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:52.563142 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-5e40be49-4975-4270-996c-02ba4ea11967 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955" status: 200 len: 1505 microversion: 2.1 time: 0.154098 May 25 15:09:52.563716 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 550/1086] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:09:52 2022] GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:53.463084 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-cdfe701e-6c6a-4b92-a602-fb08d900d47d req-1e3736b0-4bce-4d5b-8238-a570139bc3af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a088199d-3a9f-4603-b4d2-c1114297b955", "name": "network-vif-deleted", "tag": "badf52ad-4717-495a-90d8-236d0942fd5e"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:09:53.474449 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-cdfe701e-6c6a-4b92-a602-fb08d900d47d req-1e3736b0-4bce-4d5b-8238-a570139bc3af service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:53.474887 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-cdfe701e-6c6a-4b92-a602-fb08d900d47d req-1e3736b0-4bce-4d5b-8238-a570139bc3af service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:53.487489 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-cdfe701e-6c6a-4b92-a602-fb08d900d47d req-1e3736b0-4bce-4d5b-8238-a570139bc3af service nova] Creating event network-vif-deleted:badf52ad-4717-495a-90d8-236d0942fd5e for instance a088199d-3a9f-4603-b4d2-c1114297b955 on hv-cinder-80382 May 25 15:09:53.493901 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-cdfe701e-6c6a-4b92-a602-fb08d900d47d req-1e3736b0-4bce-4d5b-8238-a570139bc3af service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034629 May 25 15:09:53.495057 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 537/1087] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:09:53.582902 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-78136da1-6e55-4b36-83b5-6e4ac5fe6c62 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:53.583515 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-78136da1-6e55-4b36-83b5-6e4ac5fe6c62 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: a088199d-3a9f-4603-b4d2-c1114297b955] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:53.585912 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:53.591272 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-78136da1-6e55-4b36-83b5-6e4ac5fe6c62 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:53.591723 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-78136da1-6e55-4b36-83b5-6e4ac5fe6c62 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:53.592499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-78136da1-6e55-4b36-83b5-6e4ac5fe6c62 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:53.592932 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-78136da1-6e55-4b36-83b5-6e4ac5fe6c62 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:53.597603 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:53.628063 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-78136da1-6e55-4b36-83b5-6e4ac5fe6c62 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:53.628545 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-78136da1-6e55-4b36-83b5-6e4ac5fe6c62 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:53.629630 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.objects.instance [None req-78136da1-6e55-4b36-83b5-6e4ac5fe6c62 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lazy-loading 'fault' on Instance uuid a088199d-3a9f-4603-b4d2-c1114297b955 {{(pid=124523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:09:53.671201 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-78136da1-6e55-4b36-83b5-6e4ac5fe6c62 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:53.679482 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-78136da1-6e55-4b36-83b5-6e4ac5fe6c62 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955" status: 200 len: 1304 microversion: 2.1 time: 0.100458 May 25 15:09:53.680057 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 551/1088] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:09:53 2022] GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:54.697947 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-751fbdc4-b879-4e53-a681-17b3b35e1ecc tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:54.698691 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-751fbdc4-b879-4e53-a681-17b3b35e1ecc tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: a088199d-3a9f-4603-b4d2-c1114297b955] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:54.705429 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-751fbdc4-b879-4e53-a681-17b3b35e1ecc tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:54.705880 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-751fbdc4-b879-4e53-a681-17b3b35e1ecc tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:54.706677 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-751fbdc4-b879-4e53-a681-17b3b35e1ecc tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:54.707787 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-751fbdc4-b879-4e53-a681-17b3b35e1ecc tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:54.720889 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-751fbdc4-b879-4e53-a681-17b3b35e1ecc tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] HTTP exception thrown: Instance a088199d-3a9f-4603-b4d2-c1114297b955 could not be found. May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-751fbdc4-b879-4e53-a681-17b3b35e1ecc tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Request method failure captured: May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955 HTTP/1.1 May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkazI2fC8CZX-_P4YLLmMdHtFH4lcBDV97ssan-850xtr6VVda_UTxhy6CG_BNlZoYCdVp6hU2yFTETgQrs_Jaffd1ng45iyWVyquHSS9LlU48qF0qtbksRApKdzfywYE57ys3jDldtqxb6j1P_WbFowsCAt2-f3YzgjxL6gUQfWNd0 May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: ff8783629b6944c8ab6f93cbba5163ea May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-VolumesActionsTest-1646323124 May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:09:54.722545 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:09:54.724234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ff8783629b6944c8ab6f93cbba5163ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ff8783629b6944c8ab6f93cbba5163ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff8783629b6944c8ab6f93cbba5163ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff8783629b6944c8ab6f93cbba5163ea"}]}] May 25 15:09:54.724234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-VolumesActionsTest-1646323124 May 25 15:09:54.724234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: ff8783629b6944c8ab6f93cbba5163ea May 25 15:09:54.724234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-VolumesActionsTest-1646323124 May 25 15:09:54.724234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-VolumesActionsTest-1646323124-project May 25 15:09:54.724234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:09:54.724234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:09:54.724234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: f6a2c1100f834ac0ad12157d48bc258b May 25 15:09:54.724234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-VolumesActionsTest-1646323124-project May 25 15:09:54.724234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:09:54.724234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance a088199d-3a9f-4603-b4d2-c1114297b955 could not be found. May 25 15:09:54.724234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': 'a088199d-3a9f-4603-b4d2-c1114297b955'} May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a088199d-3a9f-4603-b4d2-c1114297b955 could not be found. May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:09:54.725445 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:09:54.727222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:09:54.727222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:09:54.727222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:09:54.727222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:09:54.727222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:09:54.727222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:09:54.727222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:09:54.727222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a088199d-3a9f-4603-b4d2-c1114297b955 could not be found. May 25 15:09:54.727222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:09:54.727222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:09:54.727222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:09:54.727222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:54.727222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:09:54.727222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:09:54.727222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:09:54.727222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:09:54.727222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a088199d-3a9f-4603-b4d2-c1114297b955 could not be found. May 25 15:09:54.727222 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:09:54.728696 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-751fbdc4-b879-4e53-a681-17b3b35e1ecc tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Returning 404 to user: Instance a088199d-3a9f-4603-b4d2-c1114297b955 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:09:54.728696 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-751fbdc4-b879-4e53-a681-17b3b35e1ecc tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955" status: 404 len: 111 microversion: 2.1 time: 0.030329 May 25 15:09:54.728696 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 538/1089] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:09:54 2022] GET /compute/v2.1/servers/a088199d-3a9f-4603-b4d2-c1114297b955 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:09:54.772136 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-9739bf75-94c7-42e9-82ce-90a38e97c545 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-965884024", "imageRef": "fbec7c78-0103-4632-9a21-d8e8056f2ce0", "flavorRef": "452", "networks": [{"uuid": "c4655b03-936b-48cf-a983-64dc8b3e6136"}]}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:09:54.822205 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.network.neutron [None req-9739bf75-94c7-42e9-82ce-90a38e97c545 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] validate_networks() for [('c4655b03-936b-48cf-a983-64dc8b3e6136', None, None, None, None, None)] {{(pid=124523) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:09:55.176310 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-9739bf75-94c7-42e9-82ce-90a38e97c545 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Flavor limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:09:55.176743 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-9739bf75-94c7-42e9-82ce-90a38e97c545 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Image limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:09:55.177276 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-9739bf75-94c7-42e9-82ce-90a38e97c545 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Flavor pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:09:55.177705 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-9739bf75-94c7-42e9-82ce-90a38e97c545 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Image pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:09:55.178150 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-9739bf75-94c7-42e9-82ce-90a38e97c545 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:09:55.187071 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9739bf75-94c7-42e9-82ce-90a38e97c545 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:55.187514 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9739bf75-94c7-42e9-82ce-90a38e97c545 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:55.188344 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9739bf75-94c7-42e9-82ce-90a38e97c545 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:55.188757 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9739bf75-94c7-42e9-82ce-90a38e97c545 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:55.206787 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-9739bf75-94c7-42e9-82ce-90a38e97c545 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Getting quotas for project ff8783629b6944c8ab6f93cbba5163ea. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:09:55.210746 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-9739bf75-94c7-42e9-82ce-90a38e97c545 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Getting quotas for user f6a2c1100f834ac0ad12157d48bc258b and project ff8783629b6944c8ab6f93cbba5163ea. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:09:55.221558 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-9739bf75-94c7-42e9-82ce-90a38e97c545 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Going to run 1 instances... {{(pid=124523) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:09:55.223869 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-9739bf75-94c7-42e9-82ce-90a38e97c545 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: e77a8b86-d120-4751-a15f-198a7897f594] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbec7c78-0103-4632-9a21-d8e8056f2ce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:09:55.269385 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-9739bf75-94c7-42e9-82ce-90a38e97c545 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501722 May 25 15:09:55.270081 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 552/1090] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 15:09:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:09:55.279716 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-cb252804-aea1-4548-aff5-c37a90e77175 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:55.280319 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-cb252804-aea1-4548-aff5-c37a90e77175 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: e77a8b86-d120-4751-a15f-198a7897f594] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:55.332981 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-cb252804-aea1-4548-aff5-c37a90e77175 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:55.339735 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-cb252804-aea1-4548-aff5-c37a90e77175 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594" status: 200 len: 1213 microversion: 2.1 time: 0.063798 May 25 15:09:55.340631 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 539/1091] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:09:55 2022] GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:56.357252 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ab0bd946-1a77-4460-8a77-1e19e631d292 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:56.358548 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ab0bd946-1a77-4460-8a77-1e19e631d292 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: e77a8b86-d120-4751-a15f-198a7897f594] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:56.365712 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ab0bd946-1a77-4460-8a77-1e19e631d292 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:56.366206 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ab0bd946-1a77-4460-8a77-1e19e631d292 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:56.367025 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ab0bd946-1a77-4460-8a77-1e19e631d292 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:56.367433 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ab0bd946-1a77-4460-8a77-1e19e631d292 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:56.449861 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ab0bd946-1a77-4460-8a77-1e19e631d292 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:56.458246 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ab0bd946-1a77-4460-8a77-1e19e631d292 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594" status: 200 len: 1283 microversion: 2.1 time: 0.105342 May 25 15:09:56.458826 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 553/1092] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:09:56 2022] GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594 => generated 1283 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:57.476065 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b919423a-996f-4e35-ac85-f87f570b4e1e tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:57.476656 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b919423a-996f-4e35-ac85-f87f570b4e1e tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: e77a8b86-d120-4751-a15f-198a7897f594] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:57.483231 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b919423a-996f-4e35-ac85-f87f570b4e1e tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:57.483802 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b919423a-996f-4e35-ac85-f87f570b4e1e tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:57.485034 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b919423a-996f-4e35-ac85-f87f570b4e1e tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:57.485709 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b919423a-996f-4e35-ac85-f87f570b4e1e tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:57.623541 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-b919423a-996f-4e35-ac85-f87f570b4e1e tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:57.632831 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b919423a-996f-4e35-ac85-f87f570b4e1e tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594" status: 200 len: 1313 microversion: 2.1 time: 0.161303 May 25 15:09:57.633422 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 540/1093] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:09:57 2022] GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:57.698336 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-e704c7b6-929f-4b07-86ab-67a41f31de85 req-cc08f4ec-ed5e-4e66-97ca-6e28fb0b32ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e77a8b86-d120-4751-a15f-198a7897f594", "tag": "39b8e344-77af-4325-8240-3e96d04789b4"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:09:57.709119 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-e704c7b6-929f-4b07-86ab-67a41f31de85 req-cc08f4ec-ed5e-4e66-97ca-6e28fb0b32ef service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:57.709611 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-e704c7b6-929f-4b07-86ab-67a41f31de85 req-cc08f4ec-ed5e-4e66-97ca-6e28fb0b32ef service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:57.722621 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-e704c7b6-929f-4b07-86ab-67a41f31de85 req-cc08f4ec-ed5e-4e66-97ca-6e28fb0b32ef service nova] Creating event network-changed:39b8e344-77af-4325-8240-3e96d04789b4 for instance e77a8b86-d120-4751-a15f-198a7897f594 on hv-cinder-80382 May 25 15:09:57.727563 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-e704c7b6-929f-4b07-86ab-67a41f31de85 req-cc08f4ec-ed5e-4e66-97ca-6e28fb0b32ef service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033892 May 25 15:09:57.728152 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 554/1094] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:09:58.651194 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-39de218c-e27c-44bc-aa13-d057d79397f4 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:58.651869 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-39de218c-e27c-44bc-aa13-d057d79397f4 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: e77a8b86-d120-4751-a15f-198a7897f594] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:58.658547 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-39de218c-e27c-44bc-aa13-d057d79397f4 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:58.658996 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-39de218c-e27c-44bc-aa13-d057d79397f4 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:58.659761 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-39de218c-e27c-44bc-aa13-d057d79397f4 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:58.660698 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-39de218c-e27c-44bc-aa13-d057d79397f4 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:58.794619 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-39de218c-e27c-44bc-aa13-d057d79397f4 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:58.802686 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-39de218c-e27c-44bc-aa13-d057d79397f4 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594" status: 200 len: 1313 microversion: 2.1 time: 0.155410 May 25 15:09:58.803261 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 541/1095] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:09:58 2022] GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:59.820390 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-6c157df8-4dda-4971-abe3-b8337ad35716 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:59.821096 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-6c157df8-4dda-4971-abe3-b8337ad35716 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: e77a8b86-d120-4751-a15f-198a7897f594] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:59.827884 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6c157df8-4dda-4971-abe3-b8337ad35716 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:59.828336 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6c157df8-4dda-4971-abe3-b8337ad35716 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:59.829111 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6c157df8-4dda-4971-abe3-b8337ad35716 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:59.829547 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-6c157df8-4dda-4971-abe3-b8337ad35716 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:59.961066 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-6c157df8-4dda-4971-abe3-b8337ad35716 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:59.968490 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-6c157df8-4dda-4971-abe3-b8337ad35716 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594" status: 200 len: 1313 microversion: 2.1 time: 0.153015 May 25 15:09:59.969044 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 555/1096] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:09:59 2022] GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:00.985256 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-87342265-05d5-44f6-b1cd-9612132a0091 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:00.985861 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-87342265-05d5-44f6-b1cd-9612132a0091 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: e77a8b86-d120-4751-a15f-198a7897f594] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:00.992444 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-87342265-05d5-44f6-b1cd-9612132a0091 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:00.992855 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-87342265-05d5-44f6-b1cd-9612132a0091 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:00.993653 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-87342265-05d5-44f6-b1cd-9612132a0091 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:00.994121 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-87342265-05d5-44f6-b1cd-9612132a0091 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:01.124306 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-87342265-05d5-44f6-b1cd-9612132a0091 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:01.132216 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-87342265-05d5-44f6-b1cd-9612132a0091 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594" status: 200 len: 1313 microversion: 2.1 time: 0.150945 May 25 15:10:01.132780 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 542/1097] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:00 2022] GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:02.149513 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2b6d2cbd-c910-49a5-86f2-caddb09bcf6a tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:02.151801 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2b6d2cbd-c910-49a5-86f2-caddb09bcf6a tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: e77a8b86-d120-4751-a15f-198a7897f594] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:02.158783 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2b6d2cbd-c910-49a5-86f2-caddb09bcf6a tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:02.159253 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2b6d2cbd-c910-49a5-86f2-caddb09bcf6a tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:02.159949 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2b6d2cbd-c910-49a5-86f2-caddb09bcf6a tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:02.160441 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2b6d2cbd-c910-49a5-86f2-caddb09bcf6a tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:02.293326 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-2b6d2cbd-c910-49a5-86f2-caddb09bcf6a tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:02.301568 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2b6d2cbd-c910-49a5-86f2-caddb09bcf6a tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594" status: 200 len: 1313 microversion: 2.1 time: 0.155295 May 25 15:10:02.302164 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 556/1098] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:02 2022] GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:02.466300 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-eca824c4-2a49-410c-8642-de7a97b8979e req-00602207-dade-4768-9c67-6b6f2d7575b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77a8b86-d120-4751-a15f-198a7897f594", "name": "network-vif-plugged", "status": "completed", "tag": "39b8e344-77af-4325-8240-3e96d04789b4"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:10:02.475752 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-eca824c4-2a49-410c-8642-de7a97b8979e req-00602207-dade-4768-9c67-6b6f2d7575b7 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:02.476213 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-eca824c4-2a49-410c-8642-de7a97b8979e req-00602207-dade-4768-9c67-6b6f2d7575b7 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:02.487464 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-eca824c4-2a49-410c-8642-de7a97b8979e req-00602207-dade-4768-9c67-6b6f2d7575b7 service nova] Creating event network-vif-plugged:39b8e344-77af-4325-8240-3e96d04789b4 for instance e77a8b86-d120-4751-a15f-198a7897f594 on hv-cinder-80382 May 25 15:10:02.492908 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-eca824c4-2a49-410c-8642-de7a97b8979e req-00602207-dade-4768-9c67-6b6f2d7575b7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030360 May 25 15:10:02.493730 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 543/1099] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:10:03.318903 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-229385b0-a001-4286-a00f-695313e240c0 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:03.319653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-229385b0-a001-4286-a00f-695313e240c0 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: e77a8b86-d120-4751-a15f-198a7897f594] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:03.326519 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-229385b0-a001-4286-a00f-695313e240c0 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:03.326867 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-229385b0-a001-4286-a00f-695313e240c0 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:03.327653 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-229385b0-a001-4286-a00f-695313e240c0 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:03.328152 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-229385b0-a001-4286-a00f-695313e240c0 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:03.461213 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-229385b0-a001-4286-a00f-695313e240c0 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:03.468684 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-229385b0-a001-4286-a00f-695313e240c0 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594" status: 200 len: 1313 microversion: 2.1 time: 0.154267 May 25 15:10:03.469246 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 557/1100] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:03 2022] GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:04.485618 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-19130b9e-27f6-4cc3-921d-1f9af1df7258 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:04.486364 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-19130b9e-27f6-4cc3-921d-1f9af1df7258 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: e77a8b86-d120-4751-a15f-198a7897f594] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:04.492621 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-19130b9e-27f6-4cc3-921d-1f9af1df7258 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:04.493070 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-19130b9e-27f6-4cc3-921d-1f9af1df7258 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:04.493834 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-19130b9e-27f6-4cc3-921d-1f9af1df7258 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:04.494291 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-19130b9e-27f6-4cc3-921d-1f9af1df7258 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:04.634473 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-19130b9e-27f6-4cc3-921d-1f9af1df7258 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:04.647233 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-19130b9e-27f6-4cc3-921d-1f9af1df7258 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594" status: 200 len: 1313 microversion: 2.1 time: 0.165924 May 25 15:10:04.648022 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 544/1101] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:04 2022] GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:05.665234 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-986b87f8-7d52-4893-86ab-f14bab795a46 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:05.665771 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-986b87f8-7d52-4893-86ab-f14bab795a46 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: e77a8b86-d120-4751-a15f-198a7897f594] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:05.668304 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=2 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:05.668966 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=6 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:05.675208 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-986b87f8-7d52-4893-86ab-f14bab795a46 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:05.675663 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-986b87f8-7d52-4893-86ab-f14bab795a46 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:05.676437 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-986b87f8-7d52-4893-86ab-f14bab795a46 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:05.676887 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-986b87f8-7d52-4893-86ab-f14bab795a46 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:05.805175 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-986b87f8-7d52-4893-86ab-f14bab795a46 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:05.813684 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-986b87f8-7d52-4893-86ab-f14bab795a46 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594" status: 200 len: 1497 microversion: 2.1 time: 0.152511 May 25 15:10:05.814297 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 558/1102] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:05 2022] GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594 => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:06.389356 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:06.394290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-458af540-307a-4b51-bf5e-5100f16c4a5c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:06.394794 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-458af540-307a-4b51-bf5e-5100f16c4a5c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: e77a8b86-d120-4751-a15f-198a7897f594] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:06.401459 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-458af540-307a-4b51-bf5e-5100f16c4a5c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:06.401908 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-458af540-307a-4b51-bf5e-5100f16c4a5c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:06.402719 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-458af540-307a-4b51-bf5e-5100f16c4a5c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:06.403157 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-458af540-307a-4b51-bf5e-5100f16c4a5c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:06.429489 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-458af540-307a-4b51-bf5e-5100f16c4a5c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: e77a8b86-d120-4751-a15f-198a7897f594] Going to try to terminate instance {{(pid=124524) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:10:06.506135 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-458af540-307a-4b51-bf5e-5100f16c4a5c tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594" status: 204 len: 0 microversion: 2.1 time: 0.117241 May 25 15:10:06.506725 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 545/1103] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:10:06 2022] DELETE /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:10:06.515507 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-5453c771-89ba-4f32-9d24-7cb541345df5 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:06.516124 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-5453c771-89ba-4f32-9d24-7cb541345df5 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: e77a8b86-d120-4751-a15f-198a7897f594] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:06.522259 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5453c771-89ba-4f32-9d24-7cb541345df5 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:06.522691 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5453c771-89ba-4f32-9d24-7cb541345df5 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:06.523449 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5453c771-89ba-4f32-9d24-7cb541345df5 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:06.523911 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-5453c771-89ba-4f32-9d24-7cb541345df5 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:06.654064 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-5453c771-89ba-4f32-9d24-7cb541345df5 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:06.661577 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-5453c771-89ba-4f32-9d24-7cb541345df5 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594" status: 200 len: 1503 microversion: 2.1 time: 0.150070 May 25 15:10:06.662165 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 559/1104] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:06 2022] GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:07.679108 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-39a645d3-2e8d-44e9-8f06-222d3d5d3542 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:07.679804 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-39a645d3-2e8d-44e9-8f06-222d3d5d3542 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: e77a8b86-d120-4751-a15f-198a7897f594] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:07.686312 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-39a645d3-2e8d-44e9-8f06-222d3d5d3542 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:07.686755 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-39a645d3-2e8d-44e9-8f06-222d3d5d3542 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:07.687509 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-39a645d3-2e8d-44e9-8f06-222d3d5d3542 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:07.687935 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-39a645d3-2e8d-44e9-8f06-222d3d5d3542 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:07.820614 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-39a645d3-2e8d-44e9-8f06-222d3d5d3542 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:07.828297 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-39a645d3-2e8d-44e9-8f06-222d3d5d3542 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594" status: 200 len: 1503 microversion: 2.1 time: 0.154068 May 25 15:10:07.828855 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 546/1105] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:07 2022] GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:08.846259 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-193fdb0d-317e-421e-8703-4033e32ef80e tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:08.846906 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-193fdb0d-317e-421e-8703-4033e32ef80e tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: e77a8b86-d120-4751-a15f-198a7897f594] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:08.855018 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-193fdb0d-317e-421e-8703-4033e32ef80e tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:08.855703 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-193fdb0d-317e-421e-8703-4033e32ef80e tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:08.856607 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-193fdb0d-317e-421e-8703-4033e32ef80e tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:08.857163 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-193fdb0d-317e-421e-8703-4033e32ef80e tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:08.933006 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-1e09421c-650d-4640-bf96-a0c062401332 req-98ebd87e-d371-464c-aeb7-73c7748f301a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77a8b86-d120-4751-a15f-198a7897f594", "name": "network-vif-deleted", "tag": "39b8e344-77af-4325-8240-3e96d04789b4"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:10:08.945974 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-1e09421c-650d-4640-bf96-a0c062401332 req-98ebd87e-d371-464c-aeb7-73c7748f301a service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:08.946736 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-1e09421c-650d-4640-bf96-a0c062401332 req-98ebd87e-d371-464c-aeb7-73c7748f301a service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:08.952888 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-193fdb0d-317e-421e-8703-4033e32ef80e tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a2c1100f834ac0ad12157d48bc258b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8783629b6944c8ab6f93cbba5163ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:08.961665 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-193fdb0d-317e-421e-8703-4033e32ef80e tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594" status: 200 len: 1461 microversion: 2.1 time: 0.119241 May 25 15:10:08.962053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-1e09421c-650d-4640-bf96-a0c062401332 req-98ebd87e-d371-464c-aeb7-73c7748f301a service nova] Creating event network-vif-deleted:39b8e344-77af-4325-8240-3e96d04789b4 for instance e77a8b86-d120-4751-a15f-198a7897f594 on hv-cinder-80382 May 25 15:10:08.962384 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 560/1106] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:08 2022] GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594 => generated 1461 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:08.967267 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-1e09421c-650d-4640-bf96-a0c062401332 req-98ebd87e-d371-464c-aeb7-73c7748f301a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038908 May 25 15:10:08.967856 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 547/1107] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:10:09.979398 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-9a575f5e-290b-4073-b90b-e5d6a1457147 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:09.980014 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-9a575f5e-290b-4073-b90b-e5d6a1457147 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] [instance: e77a8b86-d120-4751-a15f-198a7897f594] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:09.987394 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9a575f5e-290b-4073-b90b-e5d6a1457147 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:09.988802 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9a575f5e-290b-4073-b90b-e5d6a1457147 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:09.990578 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9a575f5e-290b-4073-b90b-e5d6a1457147 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:09.990578 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-9a575f5e-290b-4073-b90b-e5d6a1457147 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:10.004134 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-9a575f5e-290b-4073-b90b-e5d6a1457147 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] HTTP exception thrown: Instance e77a8b86-d120-4751-a15f-198a7897f594 could not be found. May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-9a575f5e-290b-4073-b90b-e5d6a1457147 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Request method failure captured: May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594 HTTP/1.1 May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkazI2fC8CZX-_P4YLLmMdHtFH4lcBDV97ssan-850xtr6VVda_UTxhy6CG_BNlZoYCdVp6hU2yFTETgQrs_Jaffd1ng45iyWVyquHSS9LlU48qF0qtbksRApKdzfywYE57ys3jDldtqxb6j1P_WbFowsCAt2-f3YzgjxL6gUQfWNd0 May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: ff8783629b6944c8ab6f93cbba5163ea May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-VolumesActionsTest-1646323124 May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:10:10.005850 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:10:10.007511 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ff8783629b6944c8ab6f93cbba5163ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ff8783629b6944c8ab6f93cbba5163ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff8783629b6944c8ab6f93cbba5163ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff8783629b6944c8ab6f93cbba5163ea"}]}] May 25 15:10:10.007511 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-VolumesActionsTest-1646323124 May 25 15:10:10.007511 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: ff8783629b6944c8ab6f93cbba5163ea May 25 15:10:10.007511 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-VolumesActionsTest-1646323124 May 25 15:10:10.007511 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-VolumesActionsTest-1646323124-project May 25 15:10:10.007511 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:10:10.007511 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:10:10.007511 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: f6a2c1100f834ac0ad12157d48bc258b May 25 15:10:10.007511 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-VolumesActionsTest-1646323124-project May 25 15:10:10.007511 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:10:10.007511 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance e77a8b86-d120-4751-a15f-198a7897f594 could not be found. May 25 15:10:10.007511 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': 'e77a8b86-d120-4751-a15f-198a7897f594'} May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e77a8b86-d120-4751-a15f-198a7897f594 could not be found. May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:10:10.008459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:10:10.010054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:10:10.010054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:10:10.010054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:10:10.010054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:10:10.010054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:10:10.010054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:10:10.010054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:10:10.010054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e77a8b86-d120-4751-a15f-198a7897f594 could not be found. May 25 15:10:10.010054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:10:10.010054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:10:10.010054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:10:10.010054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:10:10.010054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:10:10.010054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:10:10.010054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:10:10.010054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:10:10.010054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e77a8b86-d120-4751-a15f-198a7897f594 could not be found. May 25 15:10:10.010054 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:10:10.011648 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-9a575f5e-290b-4073-b90b-e5d6a1457147 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] Returning 404 to user: Instance e77a8b86-d120-4751-a15f-198a7897f594 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:10:10.011648 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-9a575f5e-290b-4073-b90b-e5d6a1457147 tempest-VolumesActionsTest-1646323124 tempest-VolumesActionsTest-1646323124-project] 10.222.0.78 "GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594" status: 404 len: 111 microversion: 2.1 time: 0.031816 May 25 15:10:10.011648 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 561/1108] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:09 2022] GET /compute/v2.1/servers/e77a8b86-d120-4751-a15f-198a7897f594 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:10:21.777398 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-32a4469b-22b8-44b2-9d6b-94ad36856e79 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:21.777989 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-32a4469b-22b8-44b2-9d6b-94ad36856e79 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:21.780966 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:21.787372 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:21.792228 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-93bdf097-1ef9-4d78-91af-2c4362120274 req-c537b4c4-93f6-4a14-9d1a-acf65979c39d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3433ac-9290-4294-83ad-1fa030982ca5", "tag": "d91fb4f2-8eda-4755-a625-3d06bee0b78d"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:10:21.797164 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:21.797616 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-32a4469b-22b8-44b2-9d6b-94ad36856e79 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:21.798285 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-32a4469b-22b8-44b2-9d6b-94ad36856e79 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:21.799277 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-32a4469b-22b8-44b2-9d6b-94ad36856e79 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:21.799883 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-32a4469b-22b8-44b2-9d6b-94ad36856e79 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:21.800013 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=55 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:21.821042 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-93bdf097-1ef9-4d78-91af-2c4362120274 req-c537b4c4-93f6-4a14-9d1a-acf65979c39d service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:21.821589 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-93bdf097-1ef9-4d78-91af-2c4362120274 req-c537b4c4-93f6-4a14-9d1a-acf65979c39d service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:21.837723 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-32a4469b-22b8-44b2-9d6b-94ad36856e79 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Going to try to terminate instance {{(pid=124524) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:10:21.844323 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-93bdf097-1ef9-4d78-91af-2c4362120274 req-c537b4c4-93f6-4a14-9d1a-acf65979c39d service nova] Creating event network-changed:d91fb4f2-8eda-4755-a625-3d06bee0b78d for instance dc3433ac-9290-4294-83ad-1fa030982ca5 on hv-cinder-80382 May 25 15:10:21.854200 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-93bdf097-1ef9-4d78-91af-2c4362120274 req-c537b4c4-93f6-4a14-9d1a-acf65979c39d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066221 May 25 15:10:21.857190 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 562/1109] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:10:21.951362 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-32a4469b-22b8-44b2-9d6b-94ad36856e79 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "DELETE /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 204 len: 0 microversion: 2.1 time: 0.179379 May 25 15:10:21.954753 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 548/1110] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:10:21 2022] DELETE /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:10:21.964245 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-e872c716-88e0-46e3-bec5-ec0af8ea2afe tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:21.965518 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-e872c716-88e0-46e3-bec5-ec0af8ea2afe tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:21.977488 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e872c716-88e0-46e3-bec5-ec0af8ea2afe tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:21.977951 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e872c716-88e0-46e3-bec5-ec0af8ea2afe tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:21.982216 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e872c716-88e0-46e3-bec5-ec0af8ea2afe tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:21.982982 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-e872c716-88e0-46e3-bec5-ec0af8ea2afe tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:22.184307 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-e872c716-88e0-46e3-bec5-ec0af8ea2afe tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:22.194381 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-e872c716-88e0-46e3-bec5-ec0af8ea2afe tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.234843 May 25 15:10:22.195654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 563/1111] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:21 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:23.215161 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-42832d74-fb31-473d-8c51-8f4755d28810 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:23.216061 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-42832d74-fb31-473d-8c51-8f4755d28810 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:23.232773 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-42832d74-fb31-473d-8c51-8f4755d28810 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:23.234136 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-42832d74-fb31-473d-8c51-8f4755d28810 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:23.235386 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-42832d74-fb31-473d-8c51-8f4755d28810 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:23.236208 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-42832d74-fb31-473d-8c51-8f4755d28810 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:23.487008 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-42832d74-fb31-473d-8c51-8f4755d28810 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:23.501360 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-42832d74-fb31-473d-8c51-8f4755d28810 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.291149 May 25 15:10:23.502802 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 549/1112] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:23 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:24.529178 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ea03f6f6-9326-4ce7-9b6e-9ab95f915430 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:24.529981 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ea03f6f6-9326-4ce7-9b6e-9ab95f915430 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:24.537841 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ea03f6f6-9326-4ce7-9b6e-9ab95f915430 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:24.538909 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ea03f6f6-9326-4ce7-9b6e-9ab95f915430 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:24.540120 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ea03f6f6-9326-4ce7-9b6e-9ab95f915430 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:24.540847 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ea03f6f6-9326-4ce7-9b6e-9ab95f915430 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:25.190305 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ea03f6f6-9326-4ce7-9b6e-9ab95f915430 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:25.199149 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ea03f6f6-9326-4ce7-9b6e-9ab95f915430 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1568 microversion: 2.1 time: 0.675346 May 25 15:10:25.200136 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 564/1113] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:24 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1568 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:25.580730 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-e949e85d-b864-40ac-861a-7d1179d44585 req-9e64ce12-cbf7-44e6-83bb-781b7f657476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3433ac-9290-4294-83ad-1fa030982ca5", "name": "network-vif-deleted", "tag": "d91fb4f2-8eda-4755-a625-3d06bee0b78d"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:10:25.591596 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-e949e85d-b864-40ac-861a-7d1179d44585 req-9e64ce12-cbf7-44e6-83bb-781b7f657476 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:25.592028 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-e949e85d-b864-40ac-861a-7d1179d44585 req-9e64ce12-cbf7-44e6-83bb-781b7f657476 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:25.609374 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-e949e85d-b864-40ac-861a-7d1179d44585 req-9e64ce12-cbf7-44e6-83bb-781b7f657476 service nova] Creating event network-vif-deleted:d91fb4f2-8eda-4755-a625-3d06bee0b78d for instance dc3433ac-9290-4294-83ad-1fa030982ca5 on hv-cinder-80382 May 25 15:10:25.618670 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-e949e85d-b864-40ac-861a-7d1179d44585 req-9e64ce12-cbf7-44e6-83bb-781b7f657476 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042710 May 25 15:10:25.623916 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 550/1114] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:10:26.219239 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a3885ac3-1979-4a9e-83fb-fb61920e0747 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:26.220043 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a3885ac3-1979-4a9e-83fb-fb61920e0747 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:26.227340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a3885ac3-1979-4a9e-83fb-fb61920e0747 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:26.227816 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a3885ac3-1979-4a9e-83fb-fb61920e0747 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:26.228591 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a3885ac3-1979-4a9e-83fb-fb61920e0747 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:26.229025 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a3885ac3-1979-4a9e-83fb-fb61920e0747 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:26.262824 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a3885ac3-1979-4a9e-83fb-fb61920e0747 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:26.263188 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a3885ac3-1979-4a9e-83fb-fb61920e0747 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:26.263648 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.objects.instance [None req-a3885ac3-1979-4a9e-83fb-fb61920e0747 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lazy-loading 'fault' on Instance uuid dc3433ac-9290-4294-83ad-1fa030982ca5 {{(pid=124523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:10:26.308047 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a3885ac3-1979-4a9e-83fb-fb61920e0747 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1bf697f0fd4e2cbc8d52cec772e446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb2008af6964bc5b2e94a630bfe78e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:26.315731 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a3885ac3-1979-4a9e-83fb-fb61920e0747 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 200 len: 1225 microversion: 2.1 time: 0.100514 May 25 15:10:26.316292 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 565/1115] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:26 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:27.333400 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b1f3dda3-eb10-4dd3-a360-7a352e8cd6bb tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:27.334657 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-b1f3dda3-eb10-4dd3-a360-7a352e8cd6bb tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] [instance: dc3433ac-9290-4294-83ad-1fa030982ca5] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:27.342173 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b1f3dda3-eb10-4dd3-a360-7a352e8cd6bb tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:27.342972 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b1f3dda3-eb10-4dd3-a360-7a352e8cd6bb tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:27.344132 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b1f3dda3-eb10-4dd3-a360-7a352e8cd6bb tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:27.344541 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-b1f3dda3-eb10-4dd3-a360-7a352e8cd6bb tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:27.358713 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-b1f3dda3-eb10-4dd3-a360-7a352e8cd6bb tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] HTTP exception thrown: Instance dc3433ac-9290-4294-83ad-1fa030982ca5 could not be found. May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b1f3dda3-eb10-4dd3-a360-7a352e8cd6bb tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Request method failure captured: May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 HTTP/1.1 May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkWXTDVfysD67CDfhh0yumMRKD1nS3pl47rfewSHGlqoMj6xWBa2KzByuM9Q3mwq2KULwc4-TX-KTvX1OEfbchpiMDHu5BAmRFPgWfosQjOXYw3_cvlB_FO0zNLZbc7fSFVnlij3w4zBCGQHSIF9zvf3qhG21pduGNw0kD8l3U0utTE May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: ffb2008af6964bc5b2e94a630bfe78e5 May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-TestShelveInstance-169620545 May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:10:27.360387 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:10:27.363295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ffb2008af6964bc5b2e94a630bfe78e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ffb2008af6964bc5b2e94a630bfe78e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ffb2008af6964bc5b2e94a630bfe78e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ffb2008af6964bc5b2e94a630bfe78e5"}]}] May 25 15:10:27.363295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-TestShelveInstance-169620545 May 25 15:10:27.363295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: ffb2008af6964bc5b2e94a630bfe78e5 May 25 15:10:27.363295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-TestShelveInstance-169620545 May 25 15:10:27.363295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-TestShelveInstance-169620545-project May 25 15:10:27.363295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:10:27.363295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:10:27.363295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: 9c1bf697f0fd4e2cbc8d52cec772e446 May 25 15:10:27.363295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-TestShelveInstance-169620545-project May 25 15:10:27.363295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:10:27.363295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance dc3433ac-9290-4294-83ad-1fa030982ca5 could not be found. May 25 15:10:27.363295 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': 'dc3433ac-9290-4294-83ad-1fa030982ca5'} May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc3433ac-9290-4294-83ad-1fa030982ca5 could not be found. May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:10:27.364835 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:10:27.366463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:10:27.366463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:10:27.366463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:10:27.366463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:10:27.366463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:10:27.366463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:10:27.366463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:10:27.366463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc3433ac-9290-4294-83ad-1fa030982ca5 could not be found. May 25 15:10:27.366463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:10:27.366463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:10:27.366463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:10:27.366463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:10:27.366463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:10:27.366463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:10:27.366463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:10:27.366463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:10:27.366463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc3433ac-9290-4294-83ad-1fa030982ca5 could not be found. May 25 15:10:27.366463 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:10:27.367651 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-b1f3dda3-eb10-4dd3-a360-7a352e8cd6bb tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Returning 404 to user: Instance dc3433ac-9290-4294-83ad-1fa030982ca5 could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:10:27.367651 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-b1f3dda3-eb10-4dd3-a360-7a352e8cd6bb tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5" status: 404 len: 111 microversion: 2.1 time: 0.032949 May 25 15:10:27.367651 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 551/1116] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:27 2022] GET /compute/v2.1/servers/dc3433ac-9290-4294-83ad-1fa030982ca5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:10:27.567022 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4532a100-9ffc-49ca-8bb4-10a28405e603 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] Calling method '.version_select at 0x7fb1e00c4a60>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:27.595353 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4532a100-9ffc-49ca-8bb4-10a28405e603 tempest-TestShelveInstance-169620545 tempest-TestShelveInstance-169620545-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1083162931" status: 202 len: 0 microversion: 2.1 time: 0.033528 May 25 15:10:27.596269 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 566/1117] 10.222.0.78 () {58 vars in 1253 bytes} [Wed May 25 15:10:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1083162931 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:10:41.440559 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:41.441404 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:41.445467 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-c4d95bd2-c756-482a-841e-331c2c707d23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1416279628", "imageRef": "fbec7c78-0103-4632-9a21-d8e8056f2ce0", "flavorRef": "452", "networks": [{"uuid": "a27b33a1-d531-4b31-b8e1-4bb98d480c3d"}]}} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:10:41.507018 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.network.neutron [None req-c4d95bd2-c756-482a-841e-331c2c707d23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] validate_networks() for [('a27b33a1-d531-4b31-b8e1-4bb98d480c3d', None, None, None, None, None)] {{(pid=124524) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:10:41.968598 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-c4d95bd2-c756-482a-841e-331c2c707d23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Flavor limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:10:41.969104 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-c4d95bd2-c756-482a-841e-331c2c707d23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Image limits 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:10:41.969847 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-c4d95bd2-c756-482a-841e-331c2c707d23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Flavor pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:10:41.970376 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-c4d95bd2-c756-482a-841e-331c2c707d23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Image pref 0:0:0 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:10:41.970816 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.virt.hardware [None req-c4d95bd2-c756-482a-841e-331c2c707d23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:10:41.980751 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c4d95bd2-c756-482a-841e-331c2c707d23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:41.981234 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c4d95bd2-c756-482a-841e-331c2c707d23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:41.982074 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c4d95bd2-c756-482a-841e-331c2c707d23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:41.982723 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-c4d95bd2-c756-482a-841e-331c2c707d23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:42.000617 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-c4d95bd2-c756-482a-841e-331c2c707d23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Getting quotas for project 19123d88f28441d1a7bf8ea3e7227de2. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:10:42.004715 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.quota [None req-c4d95bd2-c756-482a-841e-331c2c707d23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Getting quotas for user cc9d991e73a84f3599af9269efed898d and project 19123d88f28441d1a7bf8ea3e7227de2. Resources: {'ram', 'cores', 'instances'} {{(pid=124524) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:10:42.016331 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-c4d95bd2-c756-482a-841e-331c2c707d23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Going to run 1 instances... {{(pid=124524) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:10:42.018956 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-c4d95bd2-c756-482a-841e-331c2c707d23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: a351e97a-9090-4f83-adcb-dc9cf071770f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbec7c78-0103-4632-9a21-d8e8056f2ce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:10:42.068674 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-c4d95bd2-c756-482a-841e-331c2c707d23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629484 May 25 15:10:42.069317 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 552/1118] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 15:10:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:10:42.076937 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=22 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:42.078192 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:42.082743 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-7a4adcbc-d27c-47c3-9289-5d3b39eda1db tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:42.083363 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-7a4adcbc-d27c-47c3-9289-5d3b39eda1db tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: a351e97a-9090-4f83-adcb-dc9cf071770f] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:42.144018 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-7a4adcbc-d27c-47c3-9289-5d3b39eda1db tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:42.151433 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-7a4adcbc-d27c-47c3-9289-5d3b39eda1db tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f" status: 200 len: 1219 microversion: 2.1 time: 0.075857 May 25 15:10:42.152019 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 567/1119] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:42 2022] GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:43.170611 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7087b48d-a29a-443e-a5f4-518ff3b734ba tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:43.171965 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7087b48d-a29a-443e-a5f4-518ff3b734ba tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: a351e97a-9090-4f83-adcb-dc9cf071770f] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:43.179770 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7087b48d-a29a-443e-a5f4-518ff3b734ba tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:43.181564 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7087b48d-a29a-443e-a5f4-518ff3b734ba tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:43.181564 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7087b48d-a29a-443e-a5f4-518ff3b734ba tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:43.181564 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7087b48d-a29a-443e-a5f4-518ff3b734ba tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:43.258642 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7087b48d-a29a-443e-a5f4-518ff3b734ba tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:43.269008 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7087b48d-a29a-443e-a5f4-518ff3b734ba tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f" status: 200 len: 1279 microversion: 2.1 time: 0.103026 May 25 15:10:43.270048 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 553/1120] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:43 2022] GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f => generated 1279 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:44.287274 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4f656214-16e0-43f2-8e2c-66ad720e3cf9 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:44.287922 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4f656214-16e0-43f2-8e2c-66ad720e3cf9 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: a351e97a-9090-4f83-adcb-dc9cf071770f] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:44.294557 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4f656214-16e0-43f2-8e2c-66ad720e3cf9 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:44.294998 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4f656214-16e0-43f2-8e2c-66ad720e3cf9 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:44.295783 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4f656214-16e0-43f2-8e2c-66ad720e3cf9 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:44.296216 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4f656214-16e0-43f2-8e2c-66ad720e3cf9 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:44.781828 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4f656214-16e0-43f2-8e2c-66ad720e3cf9 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:44.789782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4f656214-16e0-43f2-8e2c-66ad720e3cf9 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f" status: 200 len: 1319 microversion: 2.1 time: 0.506671 May 25 15:10:44.790404 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 568/1121] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:44 2022] GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f => generated 1319 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:44.931473 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-0e3426a7-4499-4254-89d0-f6fd713e104c req-f4c3f0cd-b3a5-41a0-a935-7e1c53fde743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a351e97a-9090-4f83-adcb-dc9cf071770f", "tag": "44c26563-5138-421b-b20d-ec8c80a4aee9"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:10:44.941728 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-0e3426a7-4499-4254-89d0-f6fd713e104c req-f4c3f0cd-b3a5-41a0-a935-7e1c53fde743 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:44.942210 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-0e3426a7-4499-4254-89d0-f6fd713e104c req-f4c3f0cd-b3a5-41a0-a935-7e1c53fde743 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:44.956641 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-0e3426a7-4499-4254-89d0-f6fd713e104c req-f4c3f0cd-b3a5-41a0-a935-7e1c53fde743 service nova] Creating event network-changed:44c26563-5138-421b-b20d-ec8c80a4aee9 for instance a351e97a-9090-4f83-adcb-dc9cf071770f on hv-cinder-80382 May 25 15:10:44.961544 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-0e3426a7-4499-4254-89d0-f6fd713e104c req-f4c3f0cd-b3a5-41a0-a935-7e1c53fde743 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033911 May 25 15:10:44.962173 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 554/1122] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:10:45.807017 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f68576ec-d089-4a52-bac2-59da0acb3681 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:45.807638 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f68576ec-d089-4a52-bac2-59da0acb3681 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: a351e97a-9090-4f83-adcb-dc9cf071770f] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:45.814294 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f68576ec-d089-4a52-bac2-59da0acb3681 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:45.814737 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f68576ec-d089-4a52-bac2-59da0acb3681 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:45.815514 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f68576ec-d089-4a52-bac2-59da0acb3681 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:45.815950 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f68576ec-d089-4a52-bac2-59da0acb3681 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:45.962991 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-f68576ec-d089-4a52-bac2-59da0acb3681 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:45.970873 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f68576ec-d089-4a52-bac2-59da0acb3681 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f" status: 200 len: 1319 microversion: 2.1 time: 0.167707 May 25 15:10:45.971938 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 569/1123] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:45 2022] GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:46.989960 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-766e0aef-d692-43d6-b45d-0bea5f4bbff1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:46.990805 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-766e0aef-d692-43d6-b45d-0bea5f4bbff1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: a351e97a-9090-4f83-adcb-dc9cf071770f] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:46.997251 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-766e0aef-d692-43d6-b45d-0bea5f4bbff1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:46.997693 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-766e0aef-d692-43d6-b45d-0bea5f4bbff1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:46.998493 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-766e0aef-d692-43d6-b45d-0bea5f4bbff1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:46.998930 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-766e0aef-d692-43d6-b45d-0bea5f4bbff1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:47.144700 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-766e0aef-d692-43d6-b45d-0bea5f4bbff1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:47.152573 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-766e0aef-d692-43d6-b45d-0bea5f4bbff1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f" status: 200 len: 1319 microversion: 2.1 time: 0.167807 May 25 15:10:47.153163 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 555/1124] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:46 2022] GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:48.168858 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-c9454bf7-ac5f-4584-a0c1-3a07562a197c tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:48.169504 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-c9454bf7-ac5f-4584-a0c1-3a07562a197c tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: a351e97a-9090-4f83-adcb-dc9cf071770f] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:48.176029 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c9454bf7-ac5f-4584-a0c1-3a07562a197c tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:48.176459 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c9454bf7-ac5f-4584-a0c1-3a07562a197c tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:48.177216 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c9454bf7-ac5f-4584-a0c1-3a07562a197c tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:48.177654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-c9454bf7-ac5f-4584-a0c1-3a07562a197c tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:48.313687 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-c9454bf7-ac5f-4584-a0c1-3a07562a197c tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:48.321920 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-c9454bf7-ac5f-4584-a0c1-3a07562a197c tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f" status: 200 len: 1319 microversion: 2.1 time: 0.157027 May 25 15:10:48.322524 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 570/1125] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:48 2022] GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:48.690779 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [req-e9ee0d45-23af-4ae1-ae89-ecadbef63ff8 req-681be08a-1357-41b8-b230-62e014d5ad01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a351e97a-9090-4f83-adcb-dc9cf071770f", "name": "network-vif-plugged", "status": "completed", "tag": "44c26563-5138-421b-b20d-ec8c80a4aee9"}]} {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:10:48.699741 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-e9ee0d45-23af-4ae1-ae89-ecadbef63ff8 req-681be08a-1357-41b8-b230-62e014d5ad01 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:48.700186 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [req-e9ee0d45-23af-4ae1-ae89-ecadbef63ff8 req-681be08a-1357-41b8-b230-62e014d5ad01 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:48.712111 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.compute.server_external_events [req-e9ee0d45-23af-4ae1-ae89-ecadbef63ff8 req-681be08a-1357-41b8-b230-62e014d5ad01 service nova] Creating event network-vif-plugged:44c26563-5138-421b-b20d-ec8c80a4aee9 for instance a351e97a-9090-4f83-adcb-dc9cf071770f on hv-cinder-80382 May 25 15:10:48.717138 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [req-e9ee0d45-23af-4ae1-ae89-ecadbef63ff8 req-681be08a-1357-41b8-b230-62e014d5ad01 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030623 May 25 15:10:48.718115 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 556/1126] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:10:49.338654 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-8c46bc70-68c6-4ed3-8fd5-4febd52eebca tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:49.339268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-8c46bc70-68c6-4ed3-8fd5-4febd52eebca tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: a351e97a-9090-4f83-adcb-dc9cf071770f] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:49.345882 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8c46bc70-68c6-4ed3-8fd5-4febd52eebca tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:49.347068 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8c46bc70-68c6-4ed3-8fd5-4febd52eebca tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:49.348427 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8c46bc70-68c6-4ed3-8fd5-4febd52eebca tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:49.349221 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-8c46bc70-68c6-4ed3-8fd5-4febd52eebca tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:49.499530 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-8c46bc70-68c6-4ed3-8fd5-4febd52eebca tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:49.509761 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-8c46bc70-68c6-4ed3-8fd5-4febd52eebca tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f" status: 200 len: 1319 microversion: 2.1 time: 0.174939 May 25 15:10:49.510652 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 571/1127] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:49 2022] GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:10:50.528519 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-3a22e65d-5e16-4a23-b8c5-23fe769eb74b tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:10:50.529134 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-3a22e65d-5e16-4a23-b8c5-23fe769eb74b tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: a351e97a-9090-4f83-adcb-dc9cf071770f] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:10:50.536010 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3a22e65d-5e16-4a23-b8c5-23fe769eb74b tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:50.536464 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3a22e65d-5e16-4a23-b8c5-23fe769eb74b tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:50.537230 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3a22e65d-5e16-4a23-b8c5-23fe769eb74b tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:10:50.537667 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-3a22e65d-5e16-4a23-b8c5-23fe769eb74b tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:10:50.684551 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-3a22e65d-5e16-4a23-b8c5-23fe769eb74b tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:10:50.692777 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-3a22e65d-5e16-4a23-b8c5-23fe769eb74b tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f" status: 200 len: 1508 microversion: 2.1 time: 0.168528 May 25 15:10:50.693354 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 557/1128] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:10:50 2022] GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:07.966321 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-39c1a18e-df94-406d-8d0c-a5712ec219b1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d851b228-d288-493c-ad6b-94a92d7fb1f1", "device": "/dev/sdb"}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:11:07.968002 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-39c1a18e-df94-406d-8d0c-a5712ec219b1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: a351e97a-9090-4f83-adcb-dc9cf071770f] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:07.970334 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=2 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:07.971038 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=12 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:07.971749 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=24 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:07.979322 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-39c1a18e-df94-406d-8d0c-a5712ec219b1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:07.979771 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-39c1a18e-df94-406d-8d0c-a5712ec219b1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:07.980570 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-39c1a18e-df94-406d-8d0c-a5712ec219b1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:07.981011 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-39c1a18e-df94-406d-8d0c-a5712ec219b1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:08.375429 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-39c1a18e-df94-406d-8d0c-a5712ec219b1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "POST /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412958 May 25 15:11:08.376341 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 572/1129] 10.222.0.78 () {60 vars in 1322 bytes} [Wed May 25 15:11:07 2022] POST /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f/os-volume_attachments => generated 194 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:11:31.125297 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-24fe4085-2b97-42b5-85b8-e0c87298fb40 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:31.125873 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-24fe4085-2b97-42b5-85b8-e0c87298fb40 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: a351e97a-9090-4f83-adcb-dc9cf071770f] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:31.127837 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:31.128688 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=6 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:31.129292 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:31.130021 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=24 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:31.139456 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-24fe4085-2b97-42b5-85b8-e0c87298fb40 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:31.140186 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-24fe4085-2b97-42b5-85b8-e0c87298fb40 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:31.140984 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-24fe4085-2b97-42b5-85b8-e0c87298fb40 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:31.141422 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-24fe4085-2b97-42b5-85b8-e0c87298fb40 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:31.298910 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-24fe4085-2b97-42b5-85b8-e0c87298fb40 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lazy-loading 'services' on Instance uuid a351e97a-9090-4f83-adcb-dc9cf071770f {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:11:31.388659 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-24fe4085-2b97-42b5-85b8-e0c87298fb40 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f/os-volume_attachments/d851b228-d288-493c-ad6b-94a92d7fb1f1" status: 202 len: 0 microversion: 2.1 time: 0.267599 May 25 15:11:31.389271 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 558/1130] 10.222.0.78 () {58 vars in 1415 bytes} [Wed May 25 15:11:31 2022] DELETE /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f/os-volume_attachments/d851b228-d288-493c-ad6b-94a92d7fb1f1 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:11:32.523132 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=2 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:32.523837 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:32.528231 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-f38fe8f4-f4a2-4039-8b5f-0ff64ead82de tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:32.528824 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f38fe8f4-f4a2-4039-8b5f-0ff64ead82de tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: a351e97a-9090-4f83-adcb-dc9cf071770f] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:32.536437 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f38fe8f4-f4a2-4039-8b5f-0ff64ead82de tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:32.536889 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f38fe8f4-f4a2-4039-8b5f-0ff64ead82de tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:32.538333 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f38fe8f4-f4a2-4039-8b5f-0ff64ead82de tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:32.538771 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-f38fe8f4-f4a2-4039-8b5f-0ff64ead82de tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:32.566656 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-f38fe8f4-f4a2-4039-8b5f-0ff64ead82de tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: a351e97a-9090-4f83-adcb-dc9cf071770f] Going to try to terminate instance {{(pid=124523) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:11:32.651880 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-f38fe8f4-f4a2-4039-8b5f-0ff64ead82de tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f" status: 204 len: 0 microversion: 2.1 time: 0.130619 May 25 15:11:32.652559 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 573/1131] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:11:32 2022] DELETE /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:11:32.661715 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-10a3a971-052e-4b00-880b-43011aacdf01 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:32.662439 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-10a3a971-052e-4b00-880b-43011aacdf01 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: a351e97a-9090-4f83-adcb-dc9cf071770f] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:32.669587 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-10a3a971-052e-4b00-880b-43011aacdf01 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:32.669915 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-10a3a971-052e-4b00-880b-43011aacdf01 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:32.670713 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-10a3a971-052e-4b00-880b-43011aacdf01 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:32.671146 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-10a3a971-052e-4b00-880b-43011aacdf01 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:32.800390 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-10a3a971-052e-4b00-880b-43011aacdf01 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:32.808449 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-10a3a971-052e-4b00-880b-43011aacdf01 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f" status: 200 len: 1514 microversion: 2.1 time: 0.151023 May 25 15:11:32.809013 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 559/1132] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:11:32 2022] GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:33.826817 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-ca177064-ac6d-4e4b-9460-8fa3a7ceba99 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:33.827573 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-ca177064-ac6d-4e4b-9460-8fa3a7ceba99 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: a351e97a-9090-4f83-adcb-dc9cf071770f] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:33.834561 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ca177064-ac6d-4e4b-9460-8fa3a7ceba99 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:33.834972 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ca177064-ac6d-4e4b-9460-8fa3a7ceba99 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:33.835793 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ca177064-ac6d-4e4b-9460-8fa3a7ceba99 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:33.836256 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-ca177064-ac6d-4e4b-9460-8fa3a7ceba99 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:33.978986 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-ca177064-ac6d-4e4b-9460-8fa3a7ceba99 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:33.987132 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-ca177064-ac6d-4e4b-9460-8fa3a7ceba99 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f" status: 200 len: 1514 microversion: 2.1 time: 0.164803 May 25 15:11:33.987733 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 574/1133] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:11:33 2022] GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:35.004663 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-02e5ee30-7d5f-4303-8daf-a3994e94885e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:35.006614 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-02e5ee30-7d5f-4303-8daf-a3994e94885e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: a351e97a-9090-4f83-adcb-dc9cf071770f] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:35.013787 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-02e5ee30-7d5f-4303-8daf-a3994e94885e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:35.014272 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-02e5ee30-7d5f-4303-8daf-a3994e94885e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:35.015066 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-02e5ee30-7d5f-4303-8daf-a3994e94885e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:35.015500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-02e5ee30-7d5f-4303-8daf-a3994e94885e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:35.161052 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-02e5ee30-7d5f-4303-8daf-a3994e94885e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:35.171918 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-02e5ee30-7d5f-4303-8daf-a3994e94885e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f" status: 200 len: 1514 microversion: 2.1 time: 0.171059 May 25 15:11:35.172517 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 560/1134] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:11:34 2022] GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:35.217763 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-775b5f12-da98-4f95-9443-a86e7c75dd40 req-660a52c5-fff9-4f24-8df5-f25530051d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a351e97a-9090-4f83-adcb-dc9cf071770f", "name": "network-vif-deleted", "tag": "44c26563-5138-421b-b20d-ec8c80a4aee9"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:11:35.226961 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-775b5f12-da98-4f95-9443-a86e7c75dd40 req-660a52c5-fff9-4f24-8df5-f25530051d98 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:35.227403 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-775b5f12-da98-4f95-9443-a86e7c75dd40 req-660a52c5-fff9-4f24-8df5-f25530051d98 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:35.241957 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-775b5f12-da98-4f95-9443-a86e7c75dd40 req-660a52c5-fff9-4f24-8df5-f25530051d98 service nova] Creating event network-vif-deleted:44c26563-5138-421b-b20d-ec8c80a4aee9 for instance a351e97a-9090-4f83-adcb-dc9cf071770f on hv-cinder-80382 May 25 15:11:35.254838 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-775b5f12-da98-4f95-9443-a86e7c75dd40 req-660a52c5-fff9-4f24-8df5-f25530051d98 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040604 May 25 15:11:35.255715 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 575/1135] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:11:36.188757 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-90883c87-a29f-4254-8112-cb0f4aa44a23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:36.189291 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-90883c87-a29f-4254-8112-cb0f4aa44a23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: a351e97a-9090-4f83-adcb-dc9cf071770f] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:36.196500 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-90883c87-a29f-4254-8112-cb0f4aa44a23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:36.196938 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-90883c87-a29f-4254-8112-cb0f4aa44a23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:36.197690 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-90883c87-a29f-4254-8112-cb0f4aa44a23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:36.198154 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-90883c87-a29f-4254-8112-cb0f4aa44a23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:36.213863 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.wsgi [None req-90883c87-a29f-4254-8112-cb0f4aa44a23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] HTTP exception thrown: Instance a351e97a-9090-4f83-adcb-dc9cf071770f could not be found. May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-90883c87-a29f-4254-8112-cb0f4aa44a23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Request method failure captured: May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: request: GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f HTTP/1.1 May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept: application/json May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Accept-Encoding: identity May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Connection: close May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Length: 0 May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Content-Type: application/json May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Host: 10.222.0.78 May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Openstack-System-Scope: None May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: User-Agent: python-urllib3/1.26.9 May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Auth-Token: gAAAAABijkbvrIrOzZli0g0BWVoE4bo2lZPFdA3eEluvfamYy_cbm5p0aEbRx45TyyrgWzr2Qwn5Q9ShpSNkGLPhkVJ8W4EBz4aq-IztROMmJeC7h0hacxF8dLAoX0XioO59hlkN3bpckFPiqrjRpGxmGwr6WOfnDow_woPZNTeomB60zgR79SM May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Id: None May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Domain-Name: None May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Identity-Status: Confirmed May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Is-Admin-Project: True May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Id: default May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Domain-Name: Default May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Id: 19123d88f28441d1a7bf8ea3e7227de2 May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Project-Name: tempest-VolumesSnapshotTestJSON-969568102 May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Role: reader,member May 25 15:11:36.215511 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Roles: reader,member May 25 15:11:36.217283 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_19123d88f28441d1a7bf8ea3e7227de2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/19123d88f28441d1a7bf8ea3e7227de2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/19123d88f28441d1a7bf8ea3e7227de2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/19123d88f28441d1a7bf8ea3e7227de2"}]}] May 25 15:11:36.217283 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant: tempest-VolumesSnapshotTestJSON-969568102 May 25 15:11:36.217283 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Id: 19123d88f28441d1a7bf8ea3e7227de2 May 25 15:11:36.217283 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-969568102 May 25 15:11:36.217283 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User: tempest-VolumesSnapshotTestJSON-969568102-project May 25 15:11:36.217283 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Id: default May 25 15:11:36.217283 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Domain-Name: Default May 25 15:11:36.217283 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Id: cc9d991e73a84f3599af9269efed898d May 25 15:11:36.217283 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: X-User-Name: tempest-VolumesSnapshotTestJSON-969568102-project May 25 15:11:36.217283 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: method: > May 25 15:11:36.217283 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: exception: Instance a351e97a-9090-4f83-adcb-dc9cf071770f could not be found. May 25 15:11:36.217283 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: action_args: {'id': 'a351e97a-9090-4f83-adcb-dc9cf071770f'} May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a351e97a-9090-4f83-adcb-dc9cf071770f could not be found. May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:11:36.218410 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:11:36.219850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:11:36.219850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:11:36.219850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:11:36.219850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:11:36.219850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:11:36.219850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:11:36.219850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:11:36.219850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a351e97a-9090-4f83-adcb-dc9cf071770f could not be found. May 25 15:11:36.219850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:11:36.219850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:11:36.219850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:11:36.219850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:11:36.219850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:11:36.219850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:11:36.219850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:11:36.219850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:11:36.219850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a351e97a-9090-4f83-adcb-dc9cf071770f could not be found. May 25 15:11:36.219850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: ERROR nova.api.openstack.wsgi May 25 15:11:36.221360 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-90883c87-a29f-4254-8112-cb0f4aa44a23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Returning 404 to user: Instance a351e97a-9090-4f83-adcb-dc9cf071770f could not be found. {{(pid=124524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:11:36.221360 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-90883c87-a29f-4254-8112-cb0f4aa44a23 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f" status: 404 len: 111 microversion: 2.1 time: 0.032108 May 25 15:11:36.221360 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 561/1136] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:11:36 2022] GET /compute/v2.1/servers/a351e97a-9090-4f83-adcb-dc9cf071770f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:11:44.039932 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-70cf9d3a-5230-4ef2-87ac-c56956135bec tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1984152333", "imageRef": "fbec7c78-0103-4632-9a21-d8e8056f2ce0", "flavorRef": "452", "networks": [{"uuid": "a27b33a1-d531-4b31-b8e1-4bb98d480c3d"}]}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:11:44.091692 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.network.neutron [None req-70cf9d3a-5230-4ef2-87ac-c56956135bec tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] validate_networks() for [('a27b33a1-d531-4b31-b8e1-4bb98d480c3d', None, None, None, None, None)] {{(pid=124523) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:11:44.481934 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-70cf9d3a-5230-4ef2-87ac-c56956135bec tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Flavor limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:11:44.482469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-70cf9d3a-5230-4ef2-87ac-c56956135bec tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Image limits 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:11:44.482948 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-70cf9d3a-5230-4ef2-87ac-c56956135bec tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Flavor pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:11:44.483362 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-70cf9d3a-5230-4ef2-87ac-c56956135bec tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Image pref 0:0:0 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:11:44.483778 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.virt.hardware [None req-70cf9d3a-5230-4ef2-87ac-c56956135bec tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:11:44.492783 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-70cf9d3a-5230-4ef2-87ac-c56956135bec tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:44.493230 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-70cf9d3a-5230-4ef2-87ac-c56956135bec tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:44.494110 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-70cf9d3a-5230-4ef2-87ac-c56956135bec tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:44.494563 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-70cf9d3a-5230-4ef2-87ac-c56956135bec tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:44.511748 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-70cf9d3a-5230-4ef2-87ac-c56956135bec tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Getting quotas for project 19123d88f28441d1a7bf8ea3e7227de2. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:11:44.515737 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.quota [None req-70cf9d3a-5230-4ef2-87ac-c56956135bec tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Getting quotas for user cc9d991e73a84f3599af9269efed898d and project 19123d88f28441d1a7bf8ea3e7227de2. Resources: {'ram', 'cores', 'instances'} {{(pid=124523) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:11:44.527144 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-70cf9d3a-5230-4ef2-87ac-c56956135bec tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Going to run 1 instances... {{(pid=124523) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:11:44.529465 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-70cf9d3a-5230-4ef2-87ac-c56956135bec tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: 1b62c300-1304-4cdb-b569-5ff4fb8eda63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbec7c78-0103-4632-9a21-d8e8056f2ce0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:11:44.574227 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-70cf9d3a-5230-4ef2-87ac-c56956135bec tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539533 May 25 15:11:44.574870 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 576/1137] 10.222.0.78 () {60 vars in 1146 bytes} [Wed May 25 15:11:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:11:44.584868 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-76da0a66-4544-4e7f-87c7-a224dd1e9836 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:44.585484 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-76da0a66-4544-4e7f-87c7-a224dd1e9836 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: 1b62c300-1304-4cdb-b569-5ff4fb8eda63] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:44.649983 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-76da0a66-4544-4e7f-87c7-a224dd1e9836 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:44.657066 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-76da0a66-4544-4e7f-87c7-a224dd1e9836 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63" status: 200 len: 1219 microversion: 2.1 time: 0.075914 May 25 15:11:44.657641 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 562/1138] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:11:44 2022] GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:45.675832 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4db4a8d3-df2a-4bf0-ab68-975b031852aa tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:45.676505 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4db4a8d3-df2a-4bf0-ab68-975b031852aa tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: 1b62c300-1304-4cdb-b569-5ff4fb8eda63] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:45.683466 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4db4a8d3-df2a-4bf0-ab68-975b031852aa tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:45.683921 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4db4a8d3-df2a-4bf0-ab68-975b031852aa tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:45.684725 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4db4a8d3-df2a-4bf0-ab68-975b031852aa tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:45.685163 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4db4a8d3-df2a-4bf0-ab68-975b031852aa tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:45.762301 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4db4a8d3-df2a-4bf0-ab68-975b031852aa tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:45.771372 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4db4a8d3-df2a-4bf0-ab68-975b031852aa tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63" status: 200 len: 1279 microversion: 2.1 time: 0.100189 May 25 15:11:45.772295 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 577/1139] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:11:45 2022] GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63 => generated 1279 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:46.790080 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-e2fb6c74-b5ad-4c78-8e75-88276e326e32 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:46.790686 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-e2fb6c74-b5ad-4c78-8e75-88276e326e32 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: 1b62c300-1304-4cdb-b569-5ff4fb8eda63] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:46.793259 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:46.800886 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e2fb6c74-b5ad-4c78-8e75-88276e326e32 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:46.801345 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e2fb6c74-b5ad-4c78-8e75-88276e326e32 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:46.802159 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e2fb6c74-b5ad-4c78-8e75-88276e326e32 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:46.802602 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-e2fb6c74-b5ad-4c78-8e75-88276e326e32 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:46.951958 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-e2fb6c74-b5ad-4c78-8e75-88276e326e32 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:46.970451 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-e2fb6c74-b5ad-4c78-8e75-88276e326e32 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63" status: 200 len: 1319 microversion: 2.1 time: 0.184490 May 25 15:11:46.971508 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 563/1140] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:11:46 2022] GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:47.240049 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-68458787-b780-4744-8f3a-0df1e344a191 req-53b9eaf2-51ff-4296-9275-ead54b996349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b62c300-1304-4cdb-b569-5ff4fb8eda63", "tag": "155cdf49-663e-469d-9690-75cab2fbe7a9"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:11:47.249585 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-68458787-b780-4744-8f3a-0df1e344a191 req-53b9eaf2-51ff-4296-9275-ead54b996349 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:47.250055 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-68458787-b780-4744-8f3a-0df1e344a191 req-53b9eaf2-51ff-4296-9275-ead54b996349 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:47.261118 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-68458787-b780-4744-8f3a-0df1e344a191 req-53b9eaf2-51ff-4296-9275-ead54b996349 service nova] Creating event network-changed:155cdf49-663e-469d-9690-75cab2fbe7a9 for instance 1b62c300-1304-4cdb-b569-5ff4fb8eda63 on hv-cinder-80382 May 25 15:11:47.266371 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-68458787-b780-4744-8f3a-0df1e344a191 req-53b9eaf2-51ff-4296-9275-ead54b996349 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093456 May 25 15:11:47.266825 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 578/1141] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:11:47.997131 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7687ebfd-d493-4036-8476-cf2c01e9c6d1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:47.997738 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7687ebfd-d493-4036-8476-cf2c01e9c6d1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: 1b62c300-1304-4cdb-b569-5ff4fb8eda63] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:48.004290 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7687ebfd-d493-4036-8476-cf2c01e9c6d1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:48.004737 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7687ebfd-d493-4036-8476-cf2c01e9c6d1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:48.005498 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7687ebfd-d493-4036-8476-cf2c01e9c6d1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:48.005932 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7687ebfd-d493-4036-8476-cf2c01e9c6d1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:48.138616 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7687ebfd-d493-4036-8476-cf2c01e9c6d1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:48.150004 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7687ebfd-d493-4036-8476-cf2c01e9c6d1 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63" status: 200 len: 1319 microversion: 2.1 time: 0.156724 May 25 15:11:48.150585 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 564/1142] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:11:47 2022] GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:49.168373 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-dbcdca6b-92b5-4fea-a6c3-1345946dfd08 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:49.169001 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-dbcdca6b-92b5-4fea-a6c3-1345946dfd08 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: 1b62c300-1304-4cdb-b569-5ff4fb8eda63] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:49.179186 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dbcdca6b-92b5-4fea-a6c3-1345946dfd08 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:49.179682 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dbcdca6b-92b5-4fea-a6c3-1345946dfd08 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:49.180656 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dbcdca6b-92b5-4fea-a6c3-1345946dfd08 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:49.181176 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-dbcdca6b-92b5-4fea-a6c3-1345946dfd08 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:49.317165 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-dbcdca6b-92b5-4fea-a6c3-1345946dfd08 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:49.326155 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-dbcdca6b-92b5-4fea-a6c3-1345946dfd08 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63" status: 200 len: 1319 microversion: 2.1 time: 0.163393 May 25 15:11:49.326719 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 579/1143] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:11:49 2022] GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:50.342706 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-fd184c37-61c0-447e-87b6-5ff222e6b96f tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:50.343384 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-fd184c37-61c0-447e-87b6-5ff222e6b96f tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: 1b62c300-1304-4cdb-b569-5ff4fb8eda63] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:50.349989 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fd184c37-61c0-447e-87b6-5ff222e6b96f tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:50.350469 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fd184c37-61c0-447e-87b6-5ff222e6b96f tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:50.351767 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fd184c37-61c0-447e-87b6-5ff222e6b96f tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:50.352203 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-fd184c37-61c0-447e-87b6-5ff222e6b96f tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:50.481946 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-fd184c37-61c0-447e-87b6-5ff222e6b96f tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:50.489305 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-fd184c37-61c0-447e-87b6-5ff222e6b96f tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63" status: 200 len: 1319 microversion: 2.1 time: 0.150441 May 25 15:11:50.489864 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 565/1144] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:11:50 2022] GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:51.245393 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-a7d45eec-557e-41fd-9843-d16ec4332234 req-54d44b19-3944-449d-8ff2-e2c4520e89c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b62c300-1304-4cdb-b569-5ff4fb8eda63", "name": "network-vif-plugged", "status": "completed", "tag": "155cdf49-663e-469d-9690-75cab2fbe7a9"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:11:51.254223 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-a7d45eec-557e-41fd-9843-d16ec4332234 req-54d44b19-3944-449d-8ff2-e2c4520e89c6 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:51.254665 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-a7d45eec-557e-41fd-9843-d16ec4332234 req-54d44b19-3944-449d-8ff2-e2c4520e89c6 service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:51.267065 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-a7d45eec-557e-41fd-9843-d16ec4332234 req-54d44b19-3944-449d-8ff2-e2c4520e89c6 service nova] Creating event network-vif-plugged:155cdf49-663e-469d-9690-75cab2fbe7a9 for instance 1b62c300-1304-4cdb-b569-5ff4fb8eda63 on hv-cinder-80382 May 25 15:11:51.272090 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-a7d45eec-557e-41fd-9843-d16ec4332234 req-54d44b19-3944-449d-8ff2-e2c4520e89c6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030923 May 25 15:11:51.272866 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 580/1145] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:11:51.505254 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-80d9a361-23f0-45c8-b752-595b456445f4 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:51.505850 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-80d9a361-23f0-45c8-b752-595b456445f4 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: 1b62c300-1304-4cdb-b569-5ff4fb8eda63] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:51.513098 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-80d9a361-23f0-45c8-b752-595b456445f4 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:51.513540 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-80d9a361-23f0-45c8-b752-595b456445f4 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:51.514325 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-80d9a361-23f0-45c8-b752-595b456445f4 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:51.514757 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-80d9a361-23f0-45c8-b752-595b456445f4 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:51.645664 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-80d9a361-23f0-45c8-b752-595b456445f4 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:51.653514 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-80d9a361-23f0-45c8-b752-595b456445f4 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63" status: 200 len: 1319 microversion: 2.1 time: 0.152203 May 25 15:11:51.654095 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 566/1146] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:11:51 2022] GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:52.671428 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-4584b7e2-9d86-4e1a-8c9e-76b8d2a2c010 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:52.672149 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-4584b7e2-9d86-4e1a-8c9e-76b8d2a2c010 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: 1b62c300-1304-4cdb-b569-5ff4fb8eda63] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:52.680874 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4584b7e2-9d86-4e1a-8c9e-76b8d2a2c010 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:52.680874 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4584b7e2-9d86-4e1a-8c9e-76b8d2a2c010 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:52.680874 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4584b7e2-9d86-4e1a-8c9e-76b8d2a2c010 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:52.681317 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-4584b7e2-9d86-4e1a-8c9e-76b8d2a2c010 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:52.833555 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-4584b7e2-9d86-4e1a-8c9e-76b8d2a2c010 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:52.841803 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-4584b7e2-9d86-4e1a-8c9e-76b8d2a2c010 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63" status: 200 len: 1319 microversion: 2.1 time: 0.175091 May 25 15:11:52.842427 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 581/1147] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:11:52 2022] GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:53.857965 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7fa3d7bb-1069-4b6c-871e-51846c766f7e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:53.858583 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7fa3d7bb-1069-4b6c-871e-51846c766f7e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: 1b62c300-1304-4cdb-b569-5ff4fb8eda63] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:53.865041 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7fa3d7bb-1069-4b6c-871e-51846c766f7e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:53.865490 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7fa3d7bb-1069-4b6c-871e-51846c766f7e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:53.866281 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7fa3d7bb-1069-4b6c-871e-51846c766f7e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:53.866750 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7fa3d7bb-1069-4b6c-871e-51846c766f7e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:54.006039 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7fa3d7bb-1069-4b6c-871e-51846c766f7e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:54.014313 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7fa3d7bb-1069-4b6c-871e-51846c766f7e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63" status: 200 len: 1508 microversion: 2.1 time: 0.160254 May 25 15:11:54.014876 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 567/1148] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:11:53 2022] GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:54.031228 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-0f2d6b35-3464-47fd-901d-db14906ff13e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6beffb7-5593-4b96-addf-82f790e97417", "device": "/dev/sdb"}} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:11:54.032324 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-0f2d6b35-3464-47fd-901d-db14906ff13e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: 1b62c300-1304-4cdb-b569-5ff4fb8eda63] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:54.038581 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0f2d6b35-3464-47fd-901d-db14906ff13e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:54.039025 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0f2d6b35-3464-47fd-901d-db14906ff13e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:54.039802 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0f2d6b35-3464-47fd-901d-db14906ff13e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:54.040237 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-0f2d6b35-3464-47fd-901d-db14906ff13e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:54.291975 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-0f2d6b35-3464-47fd-901d-db14906ff13e tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "POST /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264436 May 25 15:11:54.292621 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 582/1149] 10.222.0.78 () {60 vars in 1322 bytes} [Wed May 25 15:11:54 2022] POST /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:12:13.742673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-665c7436-bb7b-4a7b-be36-52dc9006ad13 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:12:13.743707 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-665c7436-bb7b-4a7b-be36-52dc9006ad13 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: 1b62c300-1304-4cdb-b569-5ff4fb8eda63] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:12:13.745406 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell0:SELECT=2 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:13.746353 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_api:SELECT=22 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:13.746930 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG dbcounter [-] [124524] Writing DB stats nova_cell1:SELECT=30 {{(pid=124524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:13.753242 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-665c7436-bb7b-4a7b-be36-52dc9006ad13 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:12:13.753793 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-665c7436-bb7b-4a7b-be36-52dc9006ad13 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:12:13.754611 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-665c7436-bb7b-4a7b-be36-52dc9006ad13 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:12:13.755053 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-665c7436-bb7b-4a7b-be36-52dc9006ad13 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:12:13.848488 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.objects.instance [None req-665c7436-bb7b-4a7b-be36-52dc9006ad13 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lazy-loading 'services' on Instance uuid 1b62c300-1304-4cdb-b569-5ff4fb8eda63 {{(pid=124524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:12:13.942972 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-665c7436-bb7b-4a7b-be36-52dc9006ad13 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63/os-volume_attachments/a6beffb7-5593-4b96-addf-82f790e97417" status: 202 len: 0 microversion: 2.1 time: 0.204076 May 25 15:12:13.943582 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 568/1150] 10.222.0.78 () {58 vars in 1415 bytes} [Wed May 25 15:12:13 2022] DELETE /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63/os-volume_attachments/a6beffb7-5593-4b96-addf-82f790e97417 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 15:12:15.087930 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a908734a-268a-4a2a-bca8-c0d0f4dee1c0 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:12:15.088543 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a908734a-268a-4a2a-bca8-c0d0f4dee1c0 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: 1b62c300-1304-4cdb-b569-5ff4fb8eda63] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:12:15.091140 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=2 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:15.091902 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell0:SELECT=6 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:15.092703 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:15.093469 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG dbcounter [-] [124523] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:15.101465 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a908734a-268a-4a2a-bca8-c0d0f4dee1c0 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:12:15.101924 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a908734a-268a-4a2a-bca8-c0d0f4dee1c0 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:12:15.102751 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a908734a-268a-4a2a-bca8-c0d0f4dee1c0 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:12:15.103359 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a908734a-268a-4a2a-bca8-c0d0f4dee1c0 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:12:15.135818 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a908734a-268a-4a2a-bca8-c0d0f4dee1c0 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: 1b62c300-1304-4cdb-b569-5ff4fb8eda63] Going to try to terminate instance {{(pid=124523) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:12:15.223470 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a908734a-268a-4a2a-bca8-c0d0f4dee1c0 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63" status: 204 len: 0 microversion: 2.1 time: 0.139227 May 25 15:12:15.224581 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 583/1151] 10.222.0.78 () {58 vars in 1238 bytes} [Wed May 25 15:12:15 2022] DELETE /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:12:15.236720 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-7c7acfaa-8e48-418e-9eaf-2402983a9a4b tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:12:15.237735 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-7c7acfaa-8e48-418e-9eaf-2402983a9a4b tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: 1b62c300-1304-4cdb-b569-5ff4fb8eda63] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:12:15.245816 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7c7acfaa-8e48-418e-9eaf-2402983a9a4b tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:12:15.246310 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7c7acfaa-8e48-418e-9eaf-2402983a9a4b tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:12:15.247098 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7c7acfaa-8e48-418e-9eaf-2402983a9a4b tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:12:15.247673 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-7c7acfaa-8e48-418e-9eaf-2402983a9a4b tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:12:15.402126 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-7c7acfaa-8e48-418e-9eaf-2402983a9a4b tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:12:15.410386 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-7c7acfaa-8e48-418e-9eaf-2402983a9a4b tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63" status: 200 len: 1514 microversion: 2.1 time: 0.179277 May 25 15:12:15.410979 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 569/1152] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:12:15 2022] GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:12:16.429499 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-a4cb70f9-4e7c-425d-82d8-1fa3d665a923 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:12:16.430304 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-a4cb70f9-4e7c-425d-82d8-1fa3d665a923 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: 1b62c300-1304-4cdb-b569-5ff4fb8eda63] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:12:16.437596 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a4cb70f9-4e7c-425d-82d8-1fa3d665a923 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:12:16.438091 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a4cb70f9-4e7c-425d-82d8-1fa3d665a923 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:12:16.438991 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a4cb70f9-4e7c-425d-82d8-1fa3d665a923 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:12:16.439435 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-a4cb70f9-4e7c-425d-82d8-1fa3d665a923 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:12:16.608496 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.policy [None req-a4cb70f9-4e7c-425d-82d8-1fa3d665a923 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124523) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:12:16.617610 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-a4cb70f9-4e7c-425d-82d8-1fa3d665a923 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63" status: 200 len: 1514 microversion: 2.1 time: 0.192870 May 25 15:12:16.618244 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 584/1153] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:12:16 2022] GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:12:17.640519 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.api.openstack.wsgi [None req-10e16271-32d8-43c1-a55d-7c6ccf77f9f0 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:12:17.641624 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.compute.api [None req-10e16271-32d8-43c1-a55d-7c6ccf77f9f0 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: 1b62c300-1304-4cdb-b569-5ff4fb8eda63] Fetching instance by UUID {{(pid=124524) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:12:17.655005 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-10e16271-32d8-43c1-a55d-7c6ccf77f9f0 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:12:17.655816 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-10e16271-32d8-43c1-a55d-7c6ccf77f9f0 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:12:17.657157 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-10e16271-32d8-43c1-a55d-7c6ccf77f9f0 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:12:17.657936 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG oslo_concurrency.lockutils [None req-10e16271-32d8-43c1-a55d-7c6ccf77f9f0 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:12:17.701784 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [req-ab14dab6-4fd7-43fb-841d-befacb9f179c req-9368c635-31c3-4609-8f29-60d697f0c30c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b62c300-1304-4cdb-b569-5ff4fb8eda63", "name": "network-vif-deleted", "tag": "155cdf49-663e-469d-9690-75cab2fbe7a9"}]} {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:12:17.711753 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-ab14dab6-4fd7-43fb-841d-befacb9f179c req-9368c635-31c3-4609-8f29-60d697f0c30c service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:12:17.712208 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [req-ab14dab6-4fd7-43fb-841d-befacb9f179c req-9368c635-31c3-4609-8f29-60d697f0c30c service nova] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:12:17.729791 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.compute.server_external_events [req-ab14dab6-4fd7-43fb-841d-befacb9f179c req-9368c635-31c3-4609-8f29-60d697f0c30c service nova] Creating event network-vif-deleted:155cdf49-663e-469d-9690-75cab2fbe7a9 for instance 1b62c300-1304-4cdb-b569-5ff4fb8eda63 on hv-cinder-80382 May 25 15:12:17.735083 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [req-ab14dab6-4fd7-43fb-841d-befacb9f179c req-9368c635-31c3-4609-8f29-60d697f0c30c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037571 May 25 15:12:17.735880 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 585/1154] 10.222.0.78 () {64 vars in 1317 bytes} [Wed May 25 15:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:12:17.749321 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: DEBUG nova.policy [None req-10e16271-32d8-43c1-a55d-7c6ccf77f9f0 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9d991e73a84f3599af9269efed898d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19123d88f28441d1a7bf8ea3e7227de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124524) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:12:17.757684 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO nova.api.openstack.requestlog [None req-10e16271-32d8-43c1-a55d-7c6ccf77f9f0 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63" status: 200 len: 1472 microversion: 2.1 time: 0.126553 May 25 15:12:17.758300 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: [pid: 124524|app: 0|req: 570/1155] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:12:17 2022] GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63 => generated 1472 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:12:18.776068 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2a378829-8c3c-47ae-a40f-3720bff2e344 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Calling method '>' {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:12:18.776765 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.compute.api [None req-2a378829-8c3c-47ae-a40f-3720bff2e344 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] [instance: 1b62c300-1304-4cdb-b569-5ff4fb8eda63] Fetching instance by UUID {{(pid=124523) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:12:18.783234 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2a378829-8c3c-47ae-a40f-3720bff2e344 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:12:18.783696 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2a378829-8c3c-47ae-a40f-3720bff2e344 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:12:18.784460 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2a378829-8c3c-47ae-a40f-3720bff2e344 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:12:18.784895 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG oslo_concurrency.lockutils [None req-2a378829-8c3c-47ae-a40f-3720bff2e344 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Lock "f226ac9f-7602-4f04-9db9-a539f668d3bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:12:18.799206 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.wsgi [None req-2a378829-8c3c-47ae-a40f-3720bff2e344 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] HTTP exception thrown: Instance 1b62c300-1304-4cdb-b569-5ff4fb8eda63 could not be found. May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2a378829-8c3c-47ae-a40f-3720bff2e344 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Request method failure captured: May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: request: GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63 HTTP/1.1 May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept: application/json May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Accept-Encoding: identity May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Connection: close May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Length: 0 May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Content-Type: application/json May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Host: 10.222.0.78 May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Openstack-System-Scope: None May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: User-Agent: python-urllib3/1.26.9 May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Auth-Token: gAAAAABijkbvrIrOzZli0g0BWVoE4bo2lZPFdA3eEluvfamYy_cbm5p0aEbRx45TyyrgWzr2Qwn5Q9ShpSNkGLPhkVJ8W4EBz4aq-IztROMmJeC7h0hacxF8dLAoX0XioO59hlkN3bpckFPiqrjRpGxmGwr6WOfnDow_woPZNTeomB60zgR79SM May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Id: None May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Domain-Name: None May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Identity-Status: Confirmed May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Is-Admin-Project: True May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Id: default May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Domain-Name: Default May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Id: 19123d88f28441d1a7bf8ea3e7227de2 May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Project-Name: tempest-VolumesSnapshotTestJSON-969568102 May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Role: reader,member May 25 15:12:18.800892 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Roles: reader,member May 25 15:12:18.802782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_19123d88f28441d1a7bf8ea3e7227de2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/19123d88f28441d1a7bf8ea3e7227de2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/19123d88f28441d1a7bf8ea3e7227de2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/19123d88f28441d1a7bf8ea3e7227de2"}]}] May 25 15:12:18.802782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant: tempest-VolumesSnapshotTestJSON-969568102 May 25 15:12:18.802782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Id: 19123d88f28441d1a7bf8ea3e7227de2 May 25 15:12:18.802782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-969568102 May 25 15:12:18.802782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User: tempest-VolumesSnapshotTestJSON-969568102-project May 25 15:12:18.802782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Id: default May 25 15:12:18.802782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Domain-Name: Default May 25 15:12:18.802782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Id: cc9d991e73a84f3599af9269efed898d May 25 15:12:18.802782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: X-User-Name: tempest-VolumesSnapshotTestJSON-969568102-project May 25 15:12:18.802782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: method: > May 25 15:12:18.802782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: exception: Instance 1b62c300-1304-4cdb-b569-5ff4fb8eda63 could not be found. May 25 15:12:18.802782 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: action_args: {'id': '1b62c300-1304-4cdb-b569-5ff4fb8eda63'} May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: {{(pid=124523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b62c300-1304-4cdb-b569-5ff4fb8eda63 could not be found. May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:12:18.804368 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:12:18.806268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:12:18.806268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:12:18.806268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:12:18.806268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:12:18.806268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:12:18.806268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:12:18.806268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:12:18.806268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b62c300-1304-4cdb-b569-5ff4fb8eda63 could not be found. May 25 15:12:18.806268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:12:18.806268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:12:18.806268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:12:18.806268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:12:18.806268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:12:18.806268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:12:18.806268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:12:18.806268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:12:18.806268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b62c300-1304-4cdb-b569-5ff4fb8eda63 could not be found. May 25 15:12:18.806268 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: ERROR nova.api.openstack.wsgi May 25 15:12:18.807899 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: DEBUG nova.api.openstack.wsgi [None req-2a378829-8c3c-47ae-a40f-3720bff2e344 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] Returning 404 to user: Instance 1b62c300-1304-4cdb-b569-5ff4fb8eda63 could not be found. {{(pid=124523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:12:18.807899 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO nova.api.openstack.requestlog [None req-2a378829-8c3c-47ae-a40f-3720bff2e344 tempest-VolumesSnapshotTestJSON-969568102 tempest-VolumesSnapshotTestJSON-969568102-project] 10.222.0.78 "GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63" status: 404 len: 111 microversion: 2.1 time: 0.031308 May 25 15:12:18.807899 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: [pid: 124523|app: 0|req: 586/1156] 10.222.0.78 () {58 vars in 1235 bytes} [Wed May 25 15:12:18 2022] GET /compute/v2.1/servers/1b62c300-1304-4cdb-b569-5ff4fb8eda63 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:12:41.894928 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:12:41.895522 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Wed May 25 15:12:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:12:48.364682 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:12:48.365345 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Wed May 25 15:12:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:14:45.235860 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:14:45.236516 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Wed May 25 15:14:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:14:52.809847 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:14:52.810577 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Wed May 25 15:14:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:15:02.837963 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:15:02.838600 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Wed May 25 15:15:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:16:01.911023 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:16:01.911589 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Wed May 25 15:16:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:16:08.373438 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:16:08.374145 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Wed May 25 15:16:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:16:13.289340 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:16:13.289933 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Wed May 25 15:16:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:18:05.245169 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:18:05.245919 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Wed May 25 15:18:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:18:12.818208 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:18:12.818908 dv-cinder-803823-9-iscsi devstack@n-api.service[124523]: Wed May 25 15:18:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:18:22.845719 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:18:22.846418 dv-cinder-803823-9-iscsi devstack@n-api.service[124524]: Wed May 25 15:18:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!